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A  COMPARISON  OF  NUMERICAL  METHODS  FOR  IDENTIFICATION 
AND  OPTIMIZATION  PROBLEMS  INVOLVING  CONTROL  SYSTEMS  WITH  DELAYS 

H.T.  Banks,  J.A.  Burns  and  E.M.  Cliff 

ABSTRACT 

In  this  report  we  present  numerical  results  for  two  approximation 
techniques  for  functional  differential  control  systems.  One  technique  is 
based  on  an  averaging  scheme,  the  other  on  spline  approximations.  A  number 
of  examples  are  considered  and  the  techniques  are  applied  to  parameter 
estimation  problems  and  optimal  control  problems  where  the  systems  arc  given 
by  differential  equations  with  hereditary  terms. 


1.  Introduction. 

This  report  is  devoted  to  a  detailed  study,  via  numerical 
experiments,  of  certain  algorithms  for  the  control  and  identification 
of  linear  hereditary  systems.  In  particular,  we  shall  consider  two 
schemes  ("averaging"  and  linear  "spline"  approximations)  which  are 
based  on  the  general  approximation  method  developed  in  [1],  [2], 
r3l>  1-5-1.  The  purpose  of  this  report  is  to  present  examples  which 
facilitate  a  comparison  of  the  numerical  performance  of  these  two 
schemes  for  parameter  identification  and  for  optimal  control  pro¬ 
blems.  We  shall  not  dwell  upon  theoretical  convergence  results. 

The  interested  reader  is  referred  to  [ 5  ]  for  complete  statements 
of  convergence  results,  error  estimates  and  detailed  proofs. 


2.  Notation  and  problem  formulation. 

The  following  notation  will  be  used  throughout  the  paper.  For 
-oo  <  a  <  b  <  +  oo,  Lp(a,b;Rn)  is  the  usual  Lebesque  space  of  equi¬ 
valence  classes  of  all  functions  x:ta,b]  —  Rn  such  that  |x|^  is  in- 
tegrable.  Let  y  =  [0,r]  where  r  >  0  is  a  fixed  real  number,  and 
Z  will  denote  the  Hilbert  space  Z  =  Rn  x  L2(-r,0;Rn) .  For 
0  <  t  Sr,  the  space  Rn  x  L2(~r,0;Rn)  will  be  denoted  by  Z(r).  The 
Sobolev  space  (-r ,0;Rn)  consists  of  all  functions  in  L2(-r,0;Rn) 

with  derivatives  also  in  L2(-r,0)  and  norm  given  by 
2  2  *2 

|<p|  ei\  “  1911  +  Icpl,  •  We  assume  that  Q  and  S  are  compact  con- 

w^U  h2  L2 

vex  subsets  of  R^  and  Z,  respectively.  Moreover,  S  is  assumed  to 
have  the  property  that  if  (p  (  S  and  0  <  T  <  r,  then  the  projected 


function 
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Icp(s)  ,  -T  s  S  s  0  , 

0  ,  -r  £  S  <  -T  , 

also  belongs  to  S- 

Let  Q  =  Q  x  W  T  =  S  x  Q>  s0  that  a  generic  element  o£  r  has 
the  form  y  =  ("f),cp,q)  =  (7],cp , cr, x ) -  The  elements  Y  of  r  are  called 

the  system  parameters .  We  assume  that  for  each  a  £  Q,  Aq(#),  A^(o) 

belong  to  Rn  x  n,  B(a)  €  R°  X  ",  C(a)  €  Rkxn,  D(a)  6  Rk  x  m  and  K(a,.) 
is  an  n  x  n  matrix  valued  function  with  columns  in  L2(-r,0;Rn). 

If  x:[-t,  +  <*>)  Rn  and  t  ^  0,  the  function  x  :[-t,0]  Rn  is 
defined  by  xt<s)  =  x(t+s).  For  q  *  (a,T)  £  Q,  the  operator  L(q)  is 
defined  by 

0 

L(q)cp  =  A0(a)cp(0)  +  A^df^-T)  +  ^  K(0f,s)tp(s)  ds. 

-T 

We  consider  the  system  governed  by  the  linear  retarded  functional 
differential  equation 

(2.1)  x(t)  -  L(q)xt  +  B(or)u(t) ,  t  a  0, 

with  initial  data 

x(0)  *  n  ,  x0  =  «p  , 

y (t)  *  C(Qf)x(t)  +  D(o)u(t)  , 


(2.2) 

and  output 
(2.3) 


J 
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where  u  is  a  Rm  —  valued,  locally  integrable  control  function  and 
(T],<p)  6  Z.  Given  a  control  u  and  V  €  T>  the  solution  of  the  initial 
value  problem  (2.1)-(2.2)  at  time  t  will  be  denoted  by  x(t;y,u). 

The  corresponding  output  to  (2.1)-(2.3)  at  time  t  a  0  will  be  denoted 
by  y(t;y,u). 


REMARK.  Note  that  the  initial  function  cp  need  only  be  defined 

on  [-T,0].  If  t  <  r  and  cp  £  L^C-t.OjR11)  we  shall  identify  cp  with 

the  projected  function  tp  £  I^-r.OjR11)  defined  by  (2.0).  With 

this  understanding,  any  function  in  L^C-t.OjR0)  is  also  an  element 

of  ^(-rjOjR11).  Consequently,  for  notational  convenience  we  shall 

not  distinguish  between  cp  £  L.2(-T,0;Rn)  and  cp  £  I^C-r.OjR11). 

We  shall  be  concerned  with  the  system  on  a  fixed  finite  interval 

[0,T]  where  T  >  0.  The  matrices  G  and  W  are  n  x  n  symmetric  positive 

semi-definite,  R  is  an  m  x  m  symmetric  positive  definite  matrix  and 

^1*  y2’  ***’  yM  are  8iven  "observations"  in  Rk  at  times  t^, 

0  s  t,  <  t„  <  •••  <  tu  s  T.  The  above  notation  is  summarized  in 
l  Z.  n 

the  following  list  of  nomenclature: 

r  *  Sx  Q*  Sx  fi  x  II  -  Parameter  set 

y  *  (T],cp,q)  =  (T|»cp»or»T )  -  System  parameters 

G,  W  -  Syram.  positive  semi-definite 

R  -  Symm.  positive  definite 

X  -  Fixed  final  time 


•  •  • 


<!msT 


Observation  times 


0  <;  tx  < 
yl’  y2’  •*  yM 


Observations . 


We  now  formulate  two  infinite  dimensional  optimization  problems 
associated  with  the  hereditary  system  described  above. 

The  identification  problem  may  be  stated  as  follows: 


PROBLEM  (ID).  Given  the  control  u  in  L^COjIiR111)  and  observations 

_ 

y.  fR  at  times  t^,  find  the  system  parameters  y*  £  p  which  minimizes 
the  fit  error 

M  2 

(2.4)  E(y)  =  \  £  |y(t.;Y,u)-y.| 

i=l 

where  y(t;y,u)  _is  the  output  to  (2.1) -(2. 3),  and  the  minimization 
takes  place  over  f • 


The  optimal  control  problem  may  be  stated  as  follows: 


PROBLEM  (PC).  Given  the  system  parameters  y  €  r,  find  a 
control  u*  in  L^^TiR111)  which  minimizes  the  performance  criterion 


T 

(2.5)  J(u)  -  %[xT(T)Gx(T)]  +  \  ^  {xT(s)Wx(s)+uT(s)Ru(s)3ds, 

0 


where  x(t)  =  x(t;y,u)  is  the  solution  to  the  system  (2. 1>- (2-2) . 
The  optimal  cost  will  be  denoted  by  J*  (i.e.  J*  ■  J(u*)). 
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It  should  be  noted  that  the  above  formulation  of  the  identifi¬ 
cation  problem  allows  for  the  case  where  some  of  the  system  para¬ 
meters  y  =  are  known. 
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3.  The  abstract  Cauchy  problem  and  approximations . 

In  order  to  implement  any  numerical  algorithm  for  solving  the 
identification  and  optimal  control  problems,  it  is  necessary  to  in¬ 
troduce  approximations  at  some  stage  of  the  solution  process. 

The  basic  idea  used  in  this  paper  is  to  approximate  the  hereditary 
system  by  an  ordinary  differential  system.  We  give  a  brief  outline 
of  the  general  framework  and  present  two  particular  schemes.  Details 
of  the  method  may  be  found  in  ^2n,  T3]  and  [5"*. 

It  is  helpful  to  formulate  the  hereditary  system  (2.1) -(2. 3)  as 
an  abstract  system  in  the  Hilbert  space  Z.  Although  this  formulation 
is  not  essential  if  one  is  concerned  only  with  numerical  results,  it 
is  informative  and  indeed  necessary  if  one  is  to  fully  understand 
the  basic  ideas  underlining  the  methods  to  be  discussed  here. 

Given  q  =  (a,T)  £  Q  x  define  for  t  a  0  the  mapping 
S  (t  ;q)  :  Z  (t  )  -•  z  (T)  by 

S(t;q)  (71, cp)  =  (x(t;q),  xt(*;q)) 

where  x(*;q)  is  the  solution  to  the  homogeneous  equation  x(t) =*  L(q)xt 
with  initial  condition  (x(0),Xq)  =  (T],cp).  It  is  well  known  that  for 
each  fixed  q ,  [S  (t  ;q) }  ^  is  a  C^-semigroup  on  Z(t)  (see  [2],  [l-1). 

Moreover,  the  infinitesimal  generator  of  {S(t,q))t^Q  is  the  operator 
(2(q)  defined  on  the  domain 

fita(q))  =  {(VP)  €  Z(t)  I  CP  €  W^1)(-T,0;Rn),  cp(0)  =  Tj} 


by 


a(q)(T),<p)  =  (L(q){p,{p)  . 


m  k. 

Define  fl(q):R  -»  Z(t)  and  C(q):Z(r)  ■>  R  by  8(q)u  =  (B(a)u,0) 
and  C(q)  (7],cp)  =  C(a)T],  respectively.  Corresponding  to  the  hereditary 
system  (2.1)— (2.3)  we  have  the  abstract  (ordinary  differential) 
system  in  Z(t) 


(3.1) 


z(t)  =  a(q)z(t)  +  fl(q)u(t). 


(3.2) 


z(0)  =  (T],cp), 


(3.3) 


y(t)  =  c(q)z(t)  +  D(of)  u(t) 


A  mild  solution  to  (3.1)-(3.2)  is  given  by  the  variation  of  para¬ 
meters  formula 

(3.4)  z(t;y,u)  «  S(t;q)  (7],cp)  S(t-s;q)jl(q)u(s)  ds. 

0 

The  following  result  is  fundamental  for  all  the  approximation 
methods  we  consider.  Its  proof  may  be  found  in  f4] . 


THEOREM  3.1. 


that  y  =  (Tl.tp.q)  €  T  and  u  (  L  (0,T;R  ). 


If  x(t;Y.u)  denotes  the  solution  to  the  hereditary  equation  (2.1)- 
(2.2),  then  z  defined  by  (3.4)  satisfies 


(3.5) 


z(t;v,u)  -  (x(t;y,u) ,xt(* ;y,u)) 


(or  all  t  2  0.  .In  particular,  the  output  to  the  abstract  system 
(3.1)-(3.3)  is  the  same  as  the  output  to  the  hereditary  system  (2.1)- 


I 
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It  is  clear  from  the  above  equivalence  that  the  hereditary 
system  (2.1) -(2. 3)  can  be  approximated  by  approximating  the  abstract 
system  (3.1)-(3.3).  In  order  to  approximate  (3.1)-(3.3),  it  follows 
from  the  formula  (3.4)  and  the  equivalence  (3.5)  that  one  must 
approximate  the  following; 

i)  the  initial  data  (T| ,cp )  , 
ii)  the  semigroup  {S(t;q)}t^0, 

iii)  the  operators  fl(q),  C(q)- 

The  approximation  of  the  initial  data  is  accomplished  by  projecting 
(T],q>)  onto  a  finite  dimensional  subspace  of  Z(t).  In  order  to 
approximate  S(t;q),  recall  that  S(t;q)  is  an  evolution  operator 
which  is  sometimes  written 


S(t;q) 


ea(q)t> 


even  though  a(q)  is  unbounded.  However,  this  (formal)  identification 
illustrates  the  basic  idea;  S(t,q)  is  approximated  by  approximating 
Q(q).  Similarly,  we  must  approximate  j?(q)  and  C(q)-  Consequently, 
we  construct  approximating  systems  to  (3.1)-(3.3)  (and  hence  (2.1)- 
(2.3))  by 

1)  projecting  (T],cp)  onto  some  finite  dimensional  sub¬ 
space  of  Z(t), 

and 

2)  approximating  the  operators  d(q),  B(q)  and  C(q)* 


Although  the  above  remarks  are  based  on  formal  ideas,  the 


steps  outlined  above  can  be  effected  in  a  rigorous  mathematical 
framework.  We  shall  not  attempt  to  develop  the  relevant  theory  in  this 


paper;  rather  we  refer  the  interested  reader  to  [5]. 

We  turn  now  to  the  two  particular  schemes  that  we  have  tested 
rather  extensively  on  a  number  of  numerical  examples.  The  first  method 
(AVE)  is  based  on  step-function  approximations  to  the  initial  function 
<p,  while  the  second  method  (SPLINE)  is  based  on  linear  spline 
approximations  to  tp. 


AVE :  Corresponding  to  the  partition  t. 

„N , 


N  .  2±L 


N  ’ 


["T>°]»we  define  the  subspace  ZA(r)  =  {(7],cp)  6  Z(t) 

N  N  N 

on  each  of  the  subintervals  [ t j ,  t^_^)].  Let  Pa(t) 

N 

projection  of  Z(t)  onto  the  closed  subspace  Z  (t ) . 

A 


j  =  0, 1, • • • ,N,  of 
|  cp  is  a  constant 
be  the  orthogonal 
In  particular, 


with 


pJ(t)<TM>)  =  (7],cpN) 

N  _  N  N  N.  , 

<P  (s)~  S  Cp.  X,(s)  , 
j=l  J  J 


where  Xj  (s)  is  the  characteristic  function  for 
the  mean  (average)  value 


_N  .  ,  N  . 

tj  ^)  and  cpj  is 


N  N 
't 


s 


j-1 


cp(s)  ds 


tN 

J 


N 

j  =  1,  2,  •••  N.  We  take  (T],9  )  for  our  approximation  to  the 
initial  data  (T),9)-  To  approximate  CZ(q),  observe  that  the  first 
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coordinate  of  G(q)(7],cp)  is  simply  L(q)v  and  the  second  coordinate  is 
A.  Let  K»*r)  be  defined  by 


K^(a)  =  K(o,s)ds  =  ^  K(c*,s)  xj(s)  ds 


N 


N  H  N  N 


N 


and  suppose  that  (vn,i|i)  *  (vn,  T.  v.  \.)  belongs  to  Z  (T). 

u  u  j=  J  J  A 

L^q)  and  DN  (q)  by 

N  .  v  _  .  ,  v  N  ,  .  N  .  N  *  N 


Def ine 


and 


LN(<l)  (vq^)  ~  A0(“)  v0  +  A1(“)vn  +  Kj(c^vj 

_  ,  v ,  N  , .  N  N  M  Nn  N 
DN(q)(v0»’i,)  T^Vj-i’Vj]  Xj 


The  operator  a(q)  is  approximated  by  the  finite  dimensional  operator 
aN(q)  on  Z^(t)  defined  by 

(AqXvJj,*)  =  (^(qXvQ,*),  DN(q)(vo4))  • 

If  an  appropriate  basis  for  Z^(t)  is  selected,  then  R^N+^n 

A 

N 

can  be  identified  with  Z  (t)  and  the  above  scheme  leads  to  the 

A 

following  approximating  system.  For  N  ^  1  define  the  [  (tf+-l)n]  x  C  (N+l)n] 
N 

matrix  A  (q)  by 
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1  *„(«> 

kJ(cO  •  *  •  ^(o) 

A1 

fi 

-N  T  n 

—  I  0  • 

.  0 

(3.6) 

.N,  \ 

A  (q)  = 

0 

• 

N  T  -N  T 

T  1  ~  1  * 

#  • 

• 

• 

• 

• 

• 

0 

•  • 

•  o  fi 

• 

'ft 

where 

I  is  the  n  x 

n  identity  matrix.  The  [(N+l)n]x  m 

matrix 

BN(q) 

N 

and  the  k  x  [(N+l)n]  matrix  C  (q)  are  defined  by 

~B(o)~ 

1 

(3. 7) 

f$N(q)  = 

0 

« 

• 

and  CN(q)  -  [C(a)  0  ...  0]  , 

0  _ 

respectively . 

The  approximating  ordinary  differential  system  (of  dimension 
(Nfl)n  is  given  by 

(3.8)  zN(t)  =  AN(q)zN(t)  +  BN(q)u(t) 

N  N 

(3.9)  zw(0)  =  sjj 


(3.10) 


yN(t)  -  CN(q)zN(t)  +  D(cr)u(t)  , 
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where  z£j  =  col  (T),cp^,  •  •  *  .«P^)  •  The  approximate  system  (3.8)  -  (3.10) 
will  be  referred  to  as  the  AVE  approximation  to  (2.1)  -  (2.3). 


N  —  i  — - 

SPLINE:  Corresponding  to  the  partition  t^  =  j  =  °>1> — >N> 

N 

of  we  define  the  subspace  2^  (t  )  =  [Op(0),cp)  £  2  (t  )  |  cp  is  a  lirst 

N 

order  (niecewise  linear)  spline  function  with  knots  at  t . , 1=0, 1 , . . . ,N. } . 

N  N 

Let  Pg(T)  be  the  orthogonal  projection  of  Z(t)  onto  Zg(T).  Note 

N 

that  if  (I], cp)  £  Z(t  ) ,  then  Ps(-r)(Tl,<p)  belongs  to  /i(Q(q)).  One  can 
N 

argue  that  Ps(t)(T1,«p)  -  (7],<p)  as  K  -.  +«  and  hence  it  is  not  un¬ 
reasonable  to  expect  that  for  (''],^)  ££(G(q)) 


lim  p^(t)  aCq)^'1'^*^  =  a(q)0i,5P) 
N-+o=  S  S 

N  N  N 

Consequently,  we  define  Q  (q):Zg(r)  -.  Zg(T)  by 


(3.11) 


cN(q)  *  Pg(T)  a(q)  pg(T)- 


In  order  to  represent  the  operator  Q  (q)  and  construct  an 

ordinary  differential  system  in  Euclidean  space,  we  follow  the 

N 

general  outline  given  by  Banks  and  Kappel  [8].  Let  * j“0, 1, • • • ,N 

denote  the  scalar  first  order  spline  function  on  [~t,0]  characterized 
by 

e”(tN)  =  i,  j  =  0,  1,  ...  N  , 

j  1 


where  6^  is  the  Kronecker  symbol.  The  matrix  gN  =  [g^,  •  •  • , 0^^] 
defined  by 

-N  r  N  N  N1x>  T 

S  =  [eQ,  elf  ...,  eN}®  I 
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twhere  a  denotes  the  Kronecker  product)  is  such  that  the  sei 


A  N  N  N 

e"  =  (e“(o>,  ep 

N  N 

j  =  1,2,  •  « •  ,  N+ 1 ,  forms  a  basis  for  Z  (T).  With  this  basis  Z  ir ) 

^  S 

is  identified  with  R  and  the  following  system  may  be  con¬ 

structed. 


Let  Q  (q)  be  the  [(N+l)n]  x  [(I'B-l)n]  matrix 


0 


(3.12)  QN(q)  =  J-\ 


*  *  •  0 


(3.13) 


HN(q)  =  H^q)  +  H^(q) 


where 


N  N 

Hx(q)  and  H2(q)  are  [ (N+l)nJ  x  [(N+l)n]  matrices  defined  by 
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(3.16) 


~N.  .  r -N.  ,,-l  „N.  , 

A  (q)  =  [Q  (q)]  H  (q)  . 


Define  the  [(N+l)n]  x  m  matrix  B  (q)  and  the  k  x  [ (N+l)n]  matrix 


C  (q)  by 


(3.17)  iN(q)  =  r QN(q ) ^ "  1 


B(o) 

0 


and 


CN(q)  =  [C (a- )  0  tr. 


respectively.  Any  vector  z1  *  6  aS(T)  can  be  written 


as 


_ N.  _N 


z  =  I  (e"(0),e")57  , 
j=0  3  J  J 


N  n  N  N 

where  F  ^  €  R  .  Thus,  the  vector  z  £  Z^COcan  be  identified  with  the 

w  N  N  N.  (N+l)n 

vector  col(^),e>1,  •••|N)  in  R 

The  approximating  ordinary  differential  system  becomes 


(3.18)  zN(t)  =  AN(q)zN(t)  +  BN(q)u(t)  , 

N  N 

(3.19)  z  (0)  «  z”  , 

(3.20)  yN(t)  -  CN(q)wN(t)  +  D(er)u(t)  , 

N  (N+lln  N  N 

where  z  is  the  vector  in  identified  with  P  (t  )  (Tj )  t  Z  (t  ) . 

—  s  s 

We  shall  refer  to  the  system  (3.18)  -  (3.20)  as  Ul-  SPI, INK  approximation 
scheme  for  (2.1)  -  (2.3). 


REMARK.  When  making  computations  involving  the  spline  system 

N  - 1 

(3.18)-(3.20)  one  never  actually  computes  [Q  (q)]  but  rather 


'  — r  <  - 
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so Ives 

r-N.  ,,  N  UN ,  .  N 
[Q  (q)Jw  =  H  (q)v 

directly  in  order  to  obtain  w  *  A**(q)v  . 

Both  of  Che  above  schemes  (AVE  and  SPLINE)  fall  within  the 
general  theoretical  framework  presented  in  where  convergence 

results  and  error  estimates  are  given. 

4.  The  approximating  problems. 

► 

The  system  (3.8)-(3.10)  will  be  called  AVE  and  the  system 
(3. 18)- (3.20)  will  be  called  SPLINE.  Both  are  ordinary  differential 
systems  (of  dimension  (N+l)n)  that  approximate  the  dynamical 
response  of  the  hereditary  system  (2.1) -(2. 3).  In  order  to  state 
an  approximating  identification  problem,  we  must  approximate  the 
constraint  set  f. 

N  N 

Suppose  that  y  =  (Tl»cp ,  q)  €  T  and  that  PA(T)(1,cp)  and  Pg  ( >  )  (T],<p) 
have  the  representations  in  given  by 

P^(T)01,<p)  (T,><p^>  •  •  *»'Pjj) 

P^(t)  (T)»<p)  2=  (%o’^l*  *  * '  '^N>  ' 

Let  n?  and  n?  denote  the  mappings  from  Z  x  R'*  x  R  to  R^^"*  Ru  x  R 
A  o 

defined  by 

n^dw.oi.'O  *  (^(T)(T),{p)»»»T) 


and 
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JTgC'n.sp.o.T)  =  (Pg  (t  )  (7]»cp) » Qr>T  )  . 

Thus  motivated,  we  choose  the  approximating  constraint  sets  as 

3  Y  and  .  ^  f •  for  each  of  the  systems  (3.8)  -  (3.10)  and 

A  "A  S  S 

(3.18)  -  (3.20)  we  have  the  following  approximating  parameter  ident¬ 
ification  problem: 


PROBLEM  (1DN).  Given  the  control  u  in  L2(0,T;Rm)  and  obser- 

—  k  N  r  N  .  N. 

vations  y.  (  R  at  times  t^  find  the  parameters  €  rA  (»s  crs-) 

which  minimizes  the  fit  error 


N  N  ,  M 
(4.1)  EN(vN)  =  h  Z 

i-1 


N.  N  v  -  ,2 

y  (ti;v  ,u)  -  yt  j 


where  yN(t;yN,u)  the  output  to  the  AVE  system  (3.8)-(3.10) 
(SPLINE  system  (3 • 18) - t 3 . 20) ) ,  and  the  minimization  takes  place 

over  r!1  (over  r!?)  • 

— —  A  o 


Given  a  parameter  y  =  ( T)»tp ,  Q,r ) »  one  may  construct  the 

approximating  systems  AVE  and  SPLINE,  corresponding  to  y.  Let 
N  N 

G  and  W  be  the  (N+l)n  square  matrices  defined  by 


r 


m 
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and 


For  each  of  the  approximating  systems  AVE  and  SPLINE  we  have 
the  following  approximating  optimal  control  problems: 


PROBLEM  (OCN) .  Given  the  system  parameters  y  £  r>  find  a 
control  (Ug)  in  L^C.^R1")  which  minimizes  the  performance 
criterion 

T 

(4.2)  JN(u)=  *[(zN(T))TGNzN(T)]  +  k  ^  {(zN(s))TWNzN(s)+uT(s)Ru(s)]ds 

0 

N  N 

where,  z  (t)  =  z  (t;y,u)  solution  £&  ills.  Affl.  system  (3.8)- 

(3.10)  (SPLINE  system  (3.18)-(3.20)) .  The  optimal  cost  will  be 
denoted  by  3^(i.e.  J^(u^)). 
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For  each  N,  the  approximating  identification  and  optimal 
control  problems  are  now  finite  dimensional  in  the  sense  that  the 
dynamical  systems  AVE  and  SPLINE  are  governed  by  ordinary  differ¬ 
ential  equations  in  The  basic  idea  is  to  solve  (for 

fixed  N)  each  of  these  problems  to  obtain  ‘yy?,  and  u?.  It 

ASA  S 

can  be  shown  that  under  reasonable  conditions  ^  and  y^ 

A  S 

"converge"  to  y*  and  and  Ug  converge  to  u*  (see  [ 5  ]  for  a  pre¬ 
cise  statement  of  the  results). 

The  remainder  of  this  paper  is  devoted  to  the  study  of  numer- 
ical  examples.  In  particular,  we  compute  YA>  Yg»  UA  and  ug  and 
compare  these  values  with  the  optimal  values  Y*  and  u*  for  a 
number  of  hereditary  systems.  In  doing  so,  we  hope  to  demonstrate 
that  the  method  is  feasible  to  implement  and  that  acceptable  con¬ 
vergence  rates  are  obtained. 

All  of  the  numerical  results  presented  in  the  next  sections 
were  produced  by  computer  programs  written  at  Virginia  Tech  and 
Brown  University.  The  identification  problems  were  run  at  Virginia 
Tech  on  an  IBM  370/158  computer.  A  maximum  likelihood  (least 
squares)  algorithm  was  used  to  solve  the  approximating  problem  (IDN) . 
A  complete  discription  of  the  method  and  listing  of  the  code  may  be 
found  in  the  report  [9].  The  optimal  control  problems  were  run  at 
Brown  University  on  an  IBM  360/67  computer.  For  both  the  linear 
and  nonlinear  control  examples  a  conjugate-gradient  minimization 
algorithm  (as  described  in  [  1  ])  was  used  to  solve  the  approximating 


mm 


problem  (OCN). 
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5.  Numerical  solutions  to  the  identification  problem. 

In  this  section  we  present  a  number  of  numerical  results  for 
the  identification  problem  (PROBLEM  (ID)),  that  are  based  on  the 
approximation  schemes  (AVE  and  SPLINE)  outlined  in  the  previous 
sections.  In  order  to  generate  most  of  the  data  for  testing  the 
algorithm  we  select  a  "true"  set  of  parameters  y*  =  (Tt*, v*> a*,T*) 
and  a  control  u  and  use  the  method  of  steps  [11]  to  solve  for  x 
on  the  interval  [0,T]. 

In  all  of  the  examples  presented  below  we  used  t*  =  1  and 
u  =  u  ,  where  u  is  the  unit  step  at  t  =  (  defined  by 

0  t  <  l  , 

1  l  t  , 

and  0  <  l,  <  1.  The  final  time  of  T  =  2  was  used  in  most  of  the 
examples  (except  05.1).  The  observations  y^  =  y(t^)  were  generated 
at  101  equally  spaced  time  steps  on  [0,Tj.  In  some  examples  noise 
was  added  to  the  model  to  produce  "noisy  observations" 

y(t)  =  y(t)  +  v(t)  , 

where  v(t)  =  col(v^(t) , • • • ,v^(t))  is  a  computer  simulated  vector 
of  normal  random  variables  v^(t)  (routine  GGNQF  of  the  IMSL  library, 
see  IMSL  Users  Guide),  each  with  zero  mean  and  preset  standard 


variation. 


21- 


For  each  fixed  N,  the  approximation  Problem  (IDN)  was  solved 

using  a  maximum  likelihood  estimator  (MLE).  Since  the  Ml£  is  an 

iterative  procedure  it  is  necessary  to  supply  a  startup  (i.e.  an 

initial  guess)  for  the  optimal  parameter  yA  (or  yg  for  the  spline 

scheme).  If  0  denotes  an  unknown  parameter  to  be  estimated  (i.e. 

N  I 

3  =  a  or  0  =  t,  etc),  then  0  ’  will  denote  the  estimate  for  0 

obtained  after  I  iterations  of  the  MLE  applied  to  PROBLEM  (IDN). 

N  0 

The  startup  value  will  be  denoted  by  0  ’  . 

It  is  helpful  to  understand  the  numbering  system  for  the 
identification  examples.  The  first  two  characters  in  the  example 
number  indicate  what  model  is  used  for  the  generation  of  data.  The 
number  after  the  decimal  point  refers  to  the  specific  numerical 
run.  For  example,  all  "S2"  examples  are  problems  where  the  "true" 
system  is  governed  by 

x(t)  =  .05  x(t)  -  4.0  x(t-l)  +  u  ^(t)  , 

xQ(s)  =l,-lsssO  , 

y(t)  =  x(t)  . 

In  EXAMPLE  S2.1  we  assume  that  a*  =  -4.0  is  unknown  and  attempt 
to  estimate  this  parameter,  while  in  EXAMPLE  S2.2  we  assume  that 
the  time  delay  r*  =  1.0  is  unknown  and  estimate  this  parameter, 


etc . 
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The  figures  are  labeled  at  the  top.  In  the  left  hand  comer 
the  lettering  indicates  the  example  number,  the  value  of  N  and  the 
approximation  scheme.  For  example,  S2.1N16A  refers  to  Example 
S2.1,  N  =  16  and  the  AVE  procedure.  The  lettering  in  the  right 
hand  corner  represents  iteration  number  in  the  M1E  algorithm. 
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ID  MODEL  $2 

This  is  a  simple  scalar  model  with  discrete  delay.  The 
system  is  governed  by 

x(t)  =  .05  x(t)  -  4.0  x(t-l)  +  u  L(t)  , 

with  initial  data 

x(0)  =  1  and  Xq(s)  =1  ,  -1  s  s  <  0. 

The  output  is  simply  the  state  at  time  t,  viz: 

y (t)  =  x(t)  . 

As  described  above,  this  system  was  analytically  integrated  (using 
the  method  of  steps)  to  construct  the  solution  on  [0,2].  The 
resulting  solution  was  evaluated  at  101  equally  spaced  points  to 
generate  data  for  the  following  four  examples;  S2.1-S2.4. 


* 


JtL*. 
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EXAMPLE  S2.1 

In  this  initial  example  we  consider  the  problem  of  identifying 
a  single  parameter,  namely  the  coefficient  of  the  delayed  term  in 
the  model  S2.  Thus,  in  our  parametric  model  the  dynamics  are  des¬ 
cribed  by 


x ( t )  =  .05  x(t)  +  a^x(t-l)  +  u  ^(t) 

with  initial  condition 

x(0)  =  1  ,  xQ(s)  r  1  ,  -1  s  s  <  0  , 

and  output 


y(t)  =  x(t)  . 

For  N  =  2,  4,  8,  16  and  32  the  resulting  Problems  (1DN)  were 
"solved"  using  a  version  of  the  computer  code  described  in  [9]. 
Since  the  numerical  algorithm  is  iterative,  it  is  necessary  to 
provide  a  "start-up"  value  for  a^  and  in  this  example  we  used 

N,  0 

a^  =  0.0  . 

Hie  algorithm  provides  a  sequence  of  "improved"  estimates  for 

and  will  terminate  when  either  a  maximum  number  of  iterations  is 

N 

achieved,  or  when  the  norm  of  the  gradient  of  E  is  less  than  10 


In  the  latter  case  we  claim  that  the  procedure  has  "converged". 
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Results  of  the  numerical  experiments  for  this  example  are 
shown  in  Table  S2.1.1.  Notice  that  for  N  *  2,  the  AVE  procedure 
had  not  "converged"  at  10  iterations,  and  that  the  SPLINE  estimate 
of  the  parameter  at  N  -  4  is  better  than  the  AVE  estimate  at  N-  32. 

By  using  the  parameter  values  we  can  estimate  the  rate  of 
convergence  as 

*  tugu  ih28ii] 

0  '  In  2 

*  N 

where  e„  =  V  -  V*  is  the  error.  From  N  =  2  in  the  SPLINE  estimates 
N 

we  find  6  —  1.7,  while  for  N  =  4  in  the  AVE  result  we  estimate 
5  i  .12.  Such  estimates  for  the  rates  of  convergence  must  be 
viewed  with  caution  because  the  numerical  values  are  corrupted  by 
sources  of  error  other  than  the  approximation  scheme. 

Figures  S2.1.1  and  S2.1.2  show  the  converged  data  fits  at 
N  =  16  for  AVE  and  SPLINE,  respectively.  The  N  =  32  results  are 
essentially  the  same  as  those  for  N  =  16. 

Since  computer  requirements  are  of  practical  interest,  we 
note  that  for  N  =  32,  the  AVE  algorithm  took  about  15  sec.  per 
iteration,  while  the  SPLINE  procedure  required  a  little  over  16 
sec.  per  iteration.  This  comparison  is  not  completely  fair 
because  the  majority  of  the  code  used  is  common  to  both  AVE  and 
SPLINE  and  it  is  structured  to  provide  the  generality  needed  for 


the  SPLINE  method.  A  streamlined  code  for  AVE  alone  might  pro- 


duce  as 

much  as  a 

20%  savings 

in  execution 

time. 

AVE 

SPLINE 

aN 

N 

31 

leNl 

N 

al 

leNl 

2 

did  not 

converge 

2 

-4.1655 

.1655 

4 

-4.1144 

.1144 

4 

-4.0505 

.0505 

8 

-4.1050 

.1050 

8 

-4.0208 

.0208 

16 

-4.0852 

.0852 

16 

-4.0139 

.0139 

32 

-4.0584 

.0584 

32 

-4.0122 

.0122 

»i  ■ 

-4.0000 

* 

-4.0000 

TABLE  S2.1.1 


S2  . 

1  N 

1  6  S  I  T  R  --  4 

. 

T — 

T  ~T  T  1  1  f 

- 

*<t)  « 

. 05x ( c )  +  a^x(t-l)  +  u  x(t) 

- 

+  +  + 

data  a*  =  -4.00 

— 

SPLINE  Model  a*6,4  =  -4.0139 

FIGURE  S2.1.2 
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EXAMPLE  S2.2 


In  this  example  we  consider  the  problem  of  identifying  the 
time  delay  alone,  with  all  other  parameters  known.  Thus,  the 
parametric  model  of  the  system  is 


x(t)  =  .05  x(t)  -  4.0  x(t-r)  +  u  , (t) 


with  initial  condition 


x(0)  =  1  ,  x.(s)  =  1  ,  -r  s  s  <  0  , 


and  output 


y (t)  =  x (t)  . 


As  before,  we  conducted  numerical  experiments  for  N  =  2,  4,  8, 
16  and  32.  Our  start-up  was 


N,0 

r  =  .5  , 


while  the  true  value  is  of  course  r*  =  1.0.  At  N  =  2  and  N  =  4 

an  interesting  phenomenon  appeared;  namely,  for  the  start  up  value 

N,0 

of  r  =  0.5  the  AVE  procedure  "converged"  and  the  SPLINE  pro¬ 
cedure  "diverged".  To  examine  the  causes  of  this  result  we 

4 

evaluated  the  cost  function  E  for  AVE  and  SPLINE  at  a  variety  of 
r  values.  The  interesting  results  of  this  investigation  are  shown 
in  Figure  S2.2.1.  It  happens  that  the  SPLINE  cost  function  is 
more  "oscillatory"  than  the  AVE  cost  function  for  N  =  4.  Both 


» 


0*4*  VJfci  J* 
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have  Cwo  local  minima.  However,  Che  SPLINE  cost  function  is  such 
4  0 

that  the  start  up  r  1  =  0.5  is  not  in  the  valley  of  the  "global" 

minimum  (r^  =  .9972),  while  for  the  AVE  procedure,  r^*^  =  0.5  is 

■*4 

in  the  valley  of  the  global  minimum  (r^  =  1.2001). 

When  the  cost  function  has  more  than  a  single  local  minimum, 
the  system  is  said  to  suffer  a  lack  of  (global)  identif iability 
(at  least  for  the  specified  input).  In  such  cases  it  is  important 
to  have  good  start-up  values  for  the  parameters. 

Table  S2.2.1  illustrates  the  convergence  for  this  example. 
Note  that  for  the  reasons  outlined  above,  different  start-up 
values  were  used  for  AVE  and  SPLINE.  Again  the  results  show  that 
for  N  =  2  the  SPLINE  algorthim  gives  better  estimates  of  the 


parameter 

the  N  *  4 

r  than  AVE 

data  fits 

for  N  =  32. 

for  AVE  and 

Figures  S2.2.2  and  S2 

SPLINE,  respectively. 

.2.3  show 

AVE 

N,0  n  c 
r  =0.5 

SPLINE  rN’ 

0  »  0.8 

|e__| 

/SN 

N 

r 

1  n! 

N 

r 

2 

1.4603 

.4603 

2 

1.0084 

.0084 

4 

1.2001 

.2001 

4 

.9972 

.0028 

8 

1.0923 

.0923 

8 

.9983 

.0017 

16 

1.0439 

.0439 

16 

.9986 

.0014 

32 

1.0212 

.0212 

32 

1.0018 

.0018 

r*  * 

1.0000 

r*  » 

1.0000 

TABLE  S2.2.1 


— -  -  -  I-  ^ 


DELDY 


FIGURE  S2.2.1 


S  2 . 2N4RV 


R  =  6 


TIME 


FIGURE  S2.2.2 
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EXAMPLE  S2.3 

In  this  example  we  consider  the  problem  of  estimating  the  two 
coefficients  in  the  model.  Therefore,  the  system  is  modeled  by 


x(t)  =  aQx(t)  +  a^x(t-l)  +  u  ^t) 


with  initial  data 


x(0)  =  1  ,  Xq (s )  =  1  ,  -1  s  s  <  0  , 


and  output 


y(t)  =  x ( t )  . 

Numerical  runs  for  N  a  2,  4,  8,  16  and  32  were  conducted.  The 
start-up  values  for  ajij  “  .05  and  a£  *  -4.0  were  chosen  to  be 


N  0 

.  03  and  a^  ’ 


-3.0  . 


Table  S2.3.1  contains  a  summary  of  the  estimates  for  both  AVE  and 
SPLINE.  The  errors  ( | a^  -  a*|  +  ]a^  -  a* j )  are  given  in  Table 
S2.3.2.  Note  that  the  SPLINE  estimate  at  N  =  4  is  better  than  the 
AVE  estimate  at  N  =  32. 

Figures  S2.3.1  and  S2.3.2  show  the  converged  data  fits  at 
N  »  16  for  AVE  and  SPLINE,  respectively.  Observe  that  the  SPLINE 
procedure  provides  almost  a  "perfect"  match  to  the  data. 
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AVE 

SPLINE 

N 

ao 

N 

^  w 
ao 

al 

— 

IMilfiJ HK! 

2 

1.0869 

-4.6236 

2 

.0995 

-4.1639 

4 

.6525 

-4.3160 

4 

.0417 

-4.0523 

8 

.3825 

-4.1660 

8 

.0439 

-4.0222 

16 

.2245 

-4.0898 

16 

.0449 

-4.0151 

32 

.1384 

-4.0505 

32 

.0454 

-4.0133 

v*  - 

.0500 

-4.0000 

y*  = 

.0500 

-4.0000 

TABLE  S2.3.1 


AVE 

SPLINE 

N 

le»! 

N 

leN 

2 

1.6605 

2 

.2134 

4 

.9185 

4 

.0606 

8 

.4985 

8 

.0283 

16 

.2643 

16 

.0202 

32 

.1389 

32 

.0179 

TABLE  S2.3.2 
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I  TR=  4 


S2 . 3N16S 


TIME 

FIGURE  S2.3.2 


.  v.  .  i 
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EXAMPLE  S2.4 


This  is  the  first  example  in  which  the  "original"  identification  prob 
lem  is  truly  infinite  dimensional.  In  particular,  we  seek  to  estimate 
the  initial  data  <T)»cp)  €  R  x  L2(-l,  0;  R)  and  the  coefficient  of  the 
delayed  term.  Thus  our  model  is  described  by  the  scalar  equation 

x(t)  «  .05  x(t)  +  a^x(t-l )  +  u  x(t)  , 

with  (unknown)  initial  data 

x(0)  =  7)  ,  Xq (s )  *  cp(s)  ,  -1  s  s  <  0  , 

and  output 


y (t)  »  x(t)  . 


For  each  N  =  2,  4,  8,  16  and  32,  the  approximating  problem  (IDN) 
was  formulated  as  discussed  in  Section  4.  Thus,  for  AVE  we  seek 
the  "parameter" 

~  N  _  N  N  N  , 

Ya  “  (TJ,cp1,cp2»  ’ '  *’^N'  1^  * 

N  N  N 

where  (T],cp  1*^2*  *  ‘ *  >9^  rePresents  the  projection  of  the  initial 
data.  Similarly,  for  SPLINE  we  seek  the  "parameter" 


,  _N  _N  N  . 

Yi  = 


MM  JJ 

where  >  *  *  * »  represents  the  SPLINE  projection  of  the  initial 

data.  The  "start-up"  for  (7],q>)  (  R  x  L^ ( - 1 ,  0;  R)  is  the  zero 
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initial  data  (0,0),  while  its  true  value  is  (1,  1).  The 
"start-up"  for  a*  =  -4  is 


Table  S2.4.1  provides  an  overview  of  the  results.  Because  the 

initial  data  is  in  R  x  L^C-l,  0;  R)  we  have  only  displayed  the 

N 

Z-norm  of  the  error  and  the  estimated  value  for  a^.  The  com¬ 
parison  of  the  two  schemes  is  quite  striking,  particularly  the 
relative  ability  to  estimate  the  initial  data.  Shown  in  Figure 
S2.4.1  are  graphs  of  the  true  initial  data  and  the  corresponding 
estimates  produced  by  AVE  and  SPLINE  for  N  *  4.  It  is  apparent 
at  least  for  the  chosen  "start-up"  values  that  the  SPLINE  pro¬ 
cedure  readily  finds  good  estimates  for  the  parameters,  while  the 
AVE  scheme  has  considerable  difficulty. 

It  is  interesting  to  compare  the  sequences  of  data  fits 
generated  as  the  iteration  procedure  evolves.  Figures  S2.4.2 
through  S2.4.4  show  the  data  matches  from  the  AVE  algorithm  for 
iterations  0,  4  and  9,  respectively.  From  the  match  at  iteration 
4  (Figure  S2.4.3)  it  might  be  deduced  that  AVE  is  in  trouble.  How¬ 
ever,  at  iteration  9  the  fit  is  quite  good  and  Figure  S2.4.4  does 
not  give  any  hint  of  the  poor  values  of  the  parameters  Indicated 
in  Table  S2.4.1. 

Figures  S2.4.5  through  S2.4.7  illustrate  the  SPLINE  data 
matches  at  iterations  0,  4,  and  9  respectively.  Again  the  iteration 
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4  matches  indicate  some  difficulty  while  by  iteration  9  the  match 
is  quite  good.  It  happens  that  the  SPLINE  estimates  of  the  para¬ 
meters  are  excellent. 

Although  one  can  not  be  certain,  it  does  appear  that  AVE  is 

N 

converging  to  a  local  minimum  of  E  .  As  in  example  S2.2  we 

suspect  that  the  IDN  problem  for  AVE  suffers  a  lack  of  identifiability. 

The  IDN  problem  for  SPLINE  seems  to  be  much  better  behaved. 

In  order  to  further  investigate  identifiability  for  problems 
with  unknown  initial  data  we  essentially  repeated  this  example 
with  identical  dynamics,  changing  only  the  initial  data  to 

T[  —  1  ,  cp  (s)  =  1  +  s  ,  -1  s  s  <  0  , 

Using  the  same  start-ups  as  above  we  found  that  SPLINE  converged 


for  all 

in  Table 

N  values,  whereas  AVE  never 

S2.4.2. 

did. 

Results  are 

summarized 

AVE 

SPLINE 

N 

•?  I! 

z*(0)-SN(0)jj 

N 

-N  II 

\  II* 

*(0)-z^0)|| 

2 

-4.4103 

2.08 

2 

-4.4382 

.1595 

4 

-4.9924 

4.53 

4 

-3.9381 

.0867 

8 

-4.2651 

41.76 

8 

-4.0031 

.0287 

16 

did  not 

converge 

16 

-4.0031 

.0201 

32 

did  not 

converge 

32 

-4.0001 

.0386 

TABLE  S2.4.1 


ri>'  "ZaZEMESHZBM 


AVE 

SPLINE 

N  a^ 

l|z*(0)-$N(0)|j 

N  I*  |(z*(0)-$N(0)|| 

2 

2  -4.5201  .0563 

L 

4  -4.0975  .0318 

did  not  converge 

8 

8  -4.0282  .0123 

16 

16  -4.0123  .0193 

32 

32  -4.0122  .0936 

TABLE  S2.4.2 
(linear  initial  data) 
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S2  .  4N8RV  I  T R  =  9 


TIME 

FIGURE  S2.4.4 


Y(l) 


This  model  describes  a  (reasonably  realistic)  mechanical 


oscillator  with  retarded  restoring  and  retarded  damping  forces. 
The  system  is  governed  by  the  second  order  equation 

5c(t)  +  36x(t)  +  2.5  x(t-l)  +  9x(t-l)  =  u  L(t) 

with  initial  data 


Xq (s )  H  1  ,  XQ(s)  =  0  ,  -1  £  S  £  0  , 
and  scalar  output  (which  represents  position) 

y (t)  =  x ( t )  . 

This  second  order  equation  is  equivalent  to  the  two  dimensional 
system 


Xj^(t) 

"o 

f 

xL(t) 

0 

0 

x2(t-l) 

^0 

d 

+ 

+ 

dt 

x2(t) 

-36 

_ 

0 

x2(t) 

-9 

-2.5 

x2(t-l) 

1 

with  initial  condition 


I 

X 

1 _ 

1 

H 

1 _ 

in 

/-■v 

CO 

N-.' 

,  -1  £  s  £  0  , 


and  output 


y(t)  =  [1  0] 


x^t) 

x^Ct) 


This  system  was  integrated  forward  (using  the  method  of  steps)  to 
obtain  the  analytic  solution  on  [0,2].  Again,  data  was  generated 
at  101  equally  spaced  points  by  evaluating  the  true  solution.  This 
data  was  used  in  the  following  examples;  01.1  -  01.2. 
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EXAMPLE  01.1 

This  experiment  is  devoted  to  the  estimation  of  the  three 
coefficients  in  the  model.  Therefore,  we  assume  our  model  is 
described  by  the  second  order  equation 

2 

x(t)  +  ou  x(t)  +  aQx(t-l)  +  a^xCt-l)  =  u  ^(t) 
with  initial  data 

x0(s)  ~  1  ,  x0(s)  =0,  -1  s  S  s  0  , 


and  output 


y(t)  =  x(t)  . 


The  problem  is  to  estimate  ou,  aQ  and  a^. 

Since  the  basic  system  is  two  dimensional  for  each  N  the  approx¬ 
imating  systems  for  AVE  and  SPLINE  is  of  dimension  2-(N  +  1).  In 
order  to  keep  the  program  size  reasonably  small  (our  objective  is 
to  test  the  algorithms  and  not  to  develop  computer  codes)  we 
solved  the  approximating  identification  problems  for  N  =  2,  4,  8 
and  16.  This  allowed  us  to  use  the  same  code  for  scalar  and  two 
dimensional  systems  without  increasing  the  "size"  of  the  code; 
therefore  keeping  the  computing  cost  minimal. 

The  start-up  values  for  =  6,  ajfj  =  2.5  and  a*  =  9  were 


UN’°  -  5.0 


N,0  -  i  n 
a0  “  1,0 


5.0  . 


Tables  01.1.1  and  01.1.2  show  the  parameter  estimates  for 
AVE  and  SPLINE,  respectively.  Observe  that  the  N  =  16  estimates 
produced  by  the  AVE  procedure  are  such  that  the  "relative  I. 

leN! 

error"  — — t)  is  approximately  20%.  On  the  other  hand  the  N  =  16 

lY  I 

SPLINE  estimate  has  relative  error  of  less  than  1%. 

Figures  01.1.1-  10.1.4  compare  the  data  fits  for  N  =  2.  The 
start-ups  (ITR  =  0)  are  shown  as  well  as  the  converged  fits 
(ITR  =  10  for  AVE  and  ITR  =  14  for  SPLINE).  Figures  01.1.5-01.1.6 
show  the  converged  data  fits  for  N  -  16.  Note  that  in  this 
case  both  AVE  and  SPLINE  converged  after  4  iterations  of  the  MLE 
algorithm.  However,  the  SPLINE  procedure  provided  a  near  perfect 
data  fit. 


This  example  is  typical  of  most  of  the  vector  systems  that 
were  studied.  Generally  speaking,  the  SPLINE  algorithm  produced 
better  parameter  estimates  and  data  fits. 


AVE 

N 

~N 

*N 

oN 

0) 

ao 

31 

leN! 

2 

6.3864 

-12.8383 

4.2478 

20.4769 

4 

5.7480 

-  5.4170 

7.3614 

9.8076 

8 

5.6564 

-  1.8301 

9.7648 

5.4385 

16 

5.7873 

3.6873 

6.6713 

3.7287 

Y*  = 

6.0000 

2.5000 

9.0000 

TABLE  01.1.1 


SPLINE 


N 

5b 

!o 

aN 

h 

Isn' 

2 

6.1102 

-5.7950 

10.3718 

9.777 

4 

6.4861 

5.6291 

13.2680 

7.8832 

8 

6.0432 

2.8791 

9.2921 

.7144 

16 

6.0079 

2.5761 

9.0591 

.1431 

6.0000 


2.5000 


9 . 0000 


0  1  .  1  N2R  V 


I  TR 


T  T' 


x(t)  +  jc  x(t)  +  aQx(t-l)  +  a^x(t-l)  =  u  ^(t) 


■>  + 


+  + 
+  + 


+  +  +  data 


AVE  Model 


0.40 


u>*  -  6.0 


0.80 


a*  =  2.5  a*  -  9.0 


w2’°  =  5.0  a2’°  -  1.0  aj’°  -  5.0 

-+ - f- — (- - f  -  4-  H 


i .  ?o 


1  .  BO 


TIME 


FIGURE  01.1.1 


FIGURE  01. 1.5 
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EXAMPLE  01.2 

In  this  example  we  identify  only  the  time  delay  r.  The  system 
is  assumed  to  be  governed  by  the  model 

x(t)  +  36x (t)  +  2.5  x(t-r)  +  9x(t-r)  =  u  ^(t)  , 

with  initial  data 

Xq (s)  =  1  ,  xQ (s)  =  0  ,  -r  s  s  <,  0  , 

and  scalar  output 

y(t)  =  x(t)  , 

where  r  is  the  unknown  delay. 

This  example  proved  to  be  very  interesting.  The  start-up 
r*  =  1.0  was  taken  to  be 

rN>°=  1.2  . 

At  N  =  2,  the  AVE  procedure  did  not  converge  (in  fact  estimates 
,\2 

for  r  were  growing  without  bound) ,  while  the  SPLINE  algorithm 

2 

converged  to  the  estimate  r  =  2.3476.  At  N  =  4,  SPLINE  produced 
„  4 

the  estimate  r  =  .9830.  However,  for  N  =  4,  AVE  converged  to  the 
/s4 

estimate  of  r  =  4.8694.  For  higher  N,  the  SPLINE  procedure  pro¬ 
duced  better  and  better  estimates.  At  N  =  8  the  AVE  scheme  pro¬ 
duced  a  sequence  of  MLE  estimates  that  oscillated  between  the  values 
.7000  and  1.3000.  More  precisely,  the  MLE  iterations  continued  to 
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produce  sequences  similiar  to 

•...7113,1.0477,1.2755,  •••  ,.7082,1.0396,1.2811...  . 

Consequently,  the  N  =  8  AVE  scheme  never  "converged"!  At  N  =  16, 
both  AVE  and  SPLINE  converged  to  reasonable  estimates  of  the 
parameter  r. 

N  0 

This  example  was  repeated  using  a  start-up  value  of  r  ’  =  .8 

and  the  results  were  exactly  the  same.  Table  01.2.1  contains  a 
summary  of  the  convergence  for  this  example.  Figures  01.2.1  -01.2.4 
illustrate  the  start-ups  and  converged  data  fits  at  N  =  16  for  AVE 
and  SPLINE. 


AVE 

SPLINE 

N 

aN 

r 

!eNl 

N 

rN 

leN! 

2 

did  not 

converge 

2 

2.3476 

3.3476 

4 

-4.8694 

5.8694 

4 

.9830 

.0170 

8 

did  not 

converge 

8 

.9939 

.0061 

16 

.9274 

.0726 

16 

.9987 

.0013 

r*  = 

1 . 0000 

r*  = 

1 . 0000 

TABLE  01.2.1 
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ID  MODEL  02 


This  model  is  the  oscillator  governed  by  the  equation 
'x(t)  +  16x(t)  +  10x(t-l)  -  10x(t-l)  =  u  ^(t)  > 

with  initial  data 

xQ(s)  =  1  ,  xQ(s)  =  0  ,  -1  s  s  s  0  , 

and  scalar  output 


y(t)  =  x ( t )  . 

As  before,  data  was  generated  at  101  equally  spaced  points  by 
solving  the  system  analytically  and  evaluating  the  solution, 
data  was  used  in  the  following  examples;  02.1  -  02.2. 


This 


-67- 


EXAMPLE  02.1 

Here  we  identify  all  three  of  the  equation  coefficients.  The 
model  is  described  by 

x(t)  +  uj2x(t)  +  aQx(t-l)  +  a^x(t-l)  =  u  L(t) 
with  initial  data 


Xq  (s )  =  1  ,  xQ(s)  =  0  ,  -1  £  s  s  0  , 

and  output 


y(t)  =  x(t)  . 


We  seek  to  estimate  the  true  parameters  uj*  =  4.0,  a*  =  10.0  and 
a*  =  -10.0.  Start-up  values  for  these  parameters  were  selected  to 
be 


a)N,°  =  /20  ,  a^°  =  0.0 


-9.0  . 


Runs  were  made  for  N  =  2,  4,  8  and  16.  The  results  for  AVE  and 
SPLINE  are  summarized  in  Tables  02.1.1  and  02.1.2,  respectively. 
Again,  the  error  | e^ |  is  taken  to  be  in  the  norm,  and  the 
relative  error  at  N  =  16  is  about  37=  for  AVE  and  less  than  17„ 
for  SPLINE. 

Figures  02.1.1  -  02.1.2  show  the  N  =  16  AVE  data  fit6  for  the 
start-ups  and  converged  values  of  the  parameters.  Figures  02.1.3“ 
02.1.4  show  the  N  =  16  SPLINE  data  fits  for  the  start-ups  and 
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converged  values  of  the  parameters.  The  SPLINE  procedure  clearly 
does  better. 

In  this  example  (as  well  as  others)  we  checked  the  CPU  times 
required  for  each  run.  The  two  schemes  AVE  and  SPLINE  basically 
require  the  same  amount  of  computer  time  for  each  iteration  of  the 
ML£  algorithm.  For  example,  at  N  =  16,  the  AVE  scheme  used  approx 
imately  17.75  sec/ ITR  while  the  SPLINE  scheme  used  approximately 
18.40  sec/ITR.  Such  figures  are  typical  of  all  the  runs. 


AVE 


N 

z  1 

<3  1 

N 

fo 

aN 

al 

1  e  | 

'  N1 

2 

did 

not 

converge 

4 

did 

not 

converge 

8 

3.4386 

12.3634 

-6.6389 

.7128 

16 

3.9826 

10.4641 

-9.7997 

.6818 

4*  — 

V 

4.0000 

10.0000 

-10.0000 

TABLE  02.1.1 


SPLINE 


N 

-N 

uu 

a0 

al 

■ 

2 

3.8092 

9.0371 

-9.3642 

4 

3.9751 

9.9323 

-9.9241 

8 

3.9963 

9.9511 

-9.9978 

16 

3.9943 

9.9920 

-9.9812 

Y*  a 

4.0000 

10.0000 

-10.0000 

TABLE  02.1.2 


1.7895 

.1685 

.0548 

.0325 


time: 


FIGURE  02.1.3 


ITR=  4 


x(t)  +  U)2x(t)  +  aQx(t-l)  +  ajXCt-l)  =  u>]L(t) 

+ +•  +  data  u)*  =  4.0  3q  =  10.0  a*  =  *10.0 

-  SPLINE  Model  u,16'4  -  3.9943  aj6,4  «  9.9920  aj6'4  -  -9.9812 


— T - j - 1 — — | - \~  - — \ - ) - f  -  — — | - 

3  0.40  0.80  1.20  1.60  2. 

TIME 


FIGURE  02.1.4 
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EXAMPLE  02.2 


In  this  problem  we  seek  to  estimate  the  coefficients  of  the 
delayed  terms  and  the  time  delay  itself.  In  particular,  we  assume 
that  the  system  is  governed  by  the  model 

x(t)  +  16x(t)  +  aQx(t-r)  +  a^x(t-r)  =  u  ^(t)  , 
with  initial  data 


xQ(s)  =  1  ,  Xq (s )  =  0  ,  -r  s  s  <;  0  , 

and  output 


y(t)  -  x(t)  , 


and  the  true  parameters  to  be  estimated  are  a^  =  10.0,  a*  *  -10.0 
and  r*  =  1.0.  Start-up  values  for  each  run  were 


11.0 


-9.0 


N,0 


1.2  . 


Convergence  results  for  this  example  are  summarized  in  Tables  02.2.1 
and  02.2.2.  At  N  =  16  the  relative  error  for  AVE  is  approximately 
3.5%,  while  the  N  =  16  SPLINE  scheme  produced  a  relative  error 
of  less  than  1%. 

Figures  02.2.1  and  02.2.2  show  the  N  =  4  converged  data  fits 
for  AVE  and  SPLINE,  respectively.  For  N  s  8,  the  data  fits  are 
nearly  perfect  and  are  not  shown. 


h 


kAi 


x(t)  +  16x(t)  +  agX(C-r)  +  a^f.t-r)  *=  u^t) 


FIGURE  02.2.1 


x(t)  +  16x(t)  +  aQx(t-r)  +  a^Ct-r)  =  u  L(t) 

+  +  +  data  a*  =  10.0  a*  =  -10.0  r*  =*  1.0 


SPLINE  Model 


3q,A=  10.0927 


A  A  4.4 

a^’  =  -10.0619  r  ’*■ 


1.0076 


— -H - t- - 1---! - -F--4 - - 1  ! 

)0  0.40  0.60  1.00  1.60  ?. 

T  I  M  F 


FIGURE  02.2  .2 
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ID  MODEL  03 


This  model  is  also  a  harmonic  oscillator;  however  we  shall  use 


both  position  and  velocity  as  output  data.  In  particular,  the 


model  is  goverred  by  the  equation 


x(t)  +  4x(t)  +  x(,t-l)  -  x(t-l)  =  u  .  (t)  , 


or  in  equivalent  vector  form. 


Xj^t) 


x2(t) 


0  l|rXl(t)  0  0  X]L(t-l)  0 


.1 

0  x0(t)_j  1  -1  x,(t-l)J  Ll_ 


+  u  i (t)  , 


with  initial  data 


r  xi° 


x2(s) 


,  -1  <:  s  s  0  , 


and  vector  output 


yx(t) 


y(t)  = 


y2(t> 


i  o  X]L(t) 


o  1  I  x2(t) 


This  system  was  solved  analytically  to  obtain  data  at  101  equally 


spaced  points  for  Examples  03.1-03.4. 
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EXAMPLE  03.1 


For  this  problem  we  seek  to  estimate  two  of  the  systems  co¬ 
efficients.  In  particular,  the  model  is  assumed  to  be  governed 
by  the  equation 


x(t'  -t  4x(t)  +  aQX(t-l)  +  a^x(t-l)  =  u  ^(t) 


with  initial  data 


Xq  (s  )  =  1  ,  Xq  (s )  =  0  ,  -1  £  S  £  0  , 


and  vector  output  (both  position  and  velocity) 


y(t)  = 


yi^  i  r 


y2(t)  x(t) 


The  true  parameters  a*  =  1.0  and  a*  =  -1.0  were  estimated  using 
start-up  values  of 


a^’°=  .75  ,  aj’°-  -75  . 


Runs  with  N  =  2,  4,  8  and  16  were  made  and  the  convergence 
results  are  summarized  in  Tables  03.1.1  -  03.1.2.  Note  that  at 
N  =  16,  the  AVE  scheme  produced  parameter  estimates  considerably 
worse  (about  16%  "relative  error")  than  the  N  =  8  estimate 
(about  7%  error).  The  N  =  16  SPLINE  procedure  gave  estimates  with 


than  2 %  relative  error. 


■  i  • 
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Typical  data  fits  are  illustrated  in  Figures  03.1.1  -  03.1.8. 
Figures  03.1.1  -  03.1.2  are  the  N  =  8  AVE  start-up  data  fits  for 
the  position  (Y(l))  and  velocity  (Y(2)),  respectively.  The  con¬ 
verged  N  =  8  AVE  data  fits  are  shown  in  Figures  03.1.2  -  03.1.4. 
Figures  03.1.5  -  03.1.8  show  the  same  data  fits  for  the  N  =  8 
SPLINE  procedure. 


AVE 

N 

aN 

1  l 

fa 

fl 

1  eN  1 

2 

1.1437 

-  .8789 

.2648 

4 

1.1504 

-  .9221 

.2283 

8 

1.0951 

-  .9579 

.1372 

16 

.7215 

-1.0483 

.3261 

Y*  = 

1.0000 

-1.0000 

TABLE  03.1.1 
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SPLINE 


N 

..N 

a„ 

a? 

|e  ' 

0 

1 

1  1 

2 

1.2474 

-1.0991 

•  3(465 

4 

1.0256 

-1.0350 

.0606 

8 

.9936 

-1.0137 

.0398 

16 

.9739 

-1.0100 

.0361 

V*  = 

1.0000 

-1.0000 

TABLE  03.1.2 
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FIGURE  03.1.4 


-90- 


EXAMPLE  03.2 


In  this  example  we  attempt  to  estimate  all  of  the  system  co¬ 


efficients.  Consequently,  the  model  is  assumed  to  be  of  the  form 


:  (t)  +  j/x(t)  +  aQx(t-l)  +  a^t-l)  =  u  ^(t) 


with  initial  data 


xQ(s)  1  ,  xQ(s)  =-  0 


and  output 


y(t)  = 


The  true  parameters  x*  =  2.0,  a*  =  1.0,  a*  =  -1.0  were  estimated 
using  start-up  values  of 


N ,  0  r; — pr  N,0  7 N,0  7_ 

x  =  /3.0  ,  aQ’  =  .73  ,  a^  =  -.75 


This  example  is  again  typical  in  that  the  SPLINE  scheme  pro¬ 
duced  better  estimates  than  the  AVE  scheme  (although  the  N  =  2 
SPLINE  run  did  not  converge).  The  convergence  of  the  parameter 
estimates  is  summarized  in  Tables  03.2.1-03.2.2.  The  N  =  16 
results  show  that  the  relative  t  error  is  about  5%  for  AVE  and  17. 
for  SPLINE.  The  data  fits  for  N  =  8  and  16  were  nearly  perfect 
fits  for  both  AVE  and  SPLINE.  Consequently,  no  plots  are  given. 


’  *  PUMM 
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AVE 

N 

/.N 

a. 

1  e  1 

0 

i 

1  n' 

2 

1.2398 

3.8802 

1.3463 

5.9867 

4 

1.7711 

2.1018 

-  .2201 

2.1106 

8 

1.8955 

1.5372 

-  .6522 

.9895 

16 

1 . 9404 

.9505 

-  .9033 

.2050 

Y*  = 

2.0000 

1.0000 

-1.0000 

TABLE  03.2.1 


TABLE  03.2.2 


EXAMPLE  03.4 


For  this  example  we  seek  to  estimate  an  initial  function, 
two  system  coefficients  and  the  time  delay.  In  particular  we 
assume  that  the  initial  position  is  a  constant  but  unknown  value 
and  hence  the  model  takes  the  form 

x(t)  +  4x(t)  +  aQx(t-r)  +  a^xCt-r)  =  u  ^(t) 
with  (partially  unknown)  initial  data 

xQ(s)  =:■  C  ,  Xq  ( s )  ?  0  ,  -r  <;  s  £  0 

and  vector  output 


The  parameters  C*  =  1.0,  a*  =*  1.0,  a*  -  -1.0  and  r*  =  1.0  were 
estimated  using  start-up  values 


CN’°=  0.0, 


aN,°  =  9  aN,0  = 

0  ’  1 


N>0  -  Q 

r  =  .  9 


For  each  N  =  2,  4,  8  and  16,  the  AVE  scheme  did  not  converge. 
At  N  =  2  the  SPLINE  scheme  did  not  converge;  however,  at  N  =  4,  8 
and  16  the  SPLINE  procedure  converged  to  good  estimates  of  the 
parameters.  This  example  was  also  run  with  other  start-ups  und 
it  was  observed  that  unless  the  start-ups  were  reasonably  close 


(i.e.  as  above)  the  SPLINE  scheme  also  diverged.  The  parameter 
estimates  produced  by  the  SPLINE  scheme  are  listed  in  Table 


03.4.1.  The  error  je^|  listed  in  this  table  is  the  error" 


Observe  that  the  relative  error  at  each  N  *  4,  8,  16  is  between  1 
and  2  percent. 

Figures  03.4.1-03.4.2  show  the  N  ■  4  SPLINE  data  fits.  Note 
that  the  MI£  required  29  iterations  to  converge. 


SPLINE 


N 

~N 

C 

~N 

-N 

a0 

-N 

al 

leNl 

2 

did 

not 

converge 

— 

4 

.9960 

.9440 

1.0135 

-1.0085 

.0820 

8 

.9998 

.9999 

.9937 

-1.0137 

.0203 

16 

1.0011 

1.0156 

.9874 

-1.0131 

.0434 

Y*  = 

1.0000 

1.0000 

1.0000 

-1.0000 

I 

I 


TABLE  03.4.1 


03 
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*x(t)  +  4x(t)  +  aQx(t-r)  +  a^x(t-r)  3  u  ^(t) 


xQ(s)  s  C  ,  xQ(s)  =  0 


+  +  +  data  C*  3  1.0  r*  3  1.0  a*  3  1.0  a* 

4  29  4  29  4  29 

_  SPLINE  Model  C  ’  -.9960  r  *  -.9440  aj’  -1.0135  a 


FIGURE  03.4.1 
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FIGURE  03.4.2 
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ID  MODEL  04 

This  model  is  Che  oscillator  considered  in  ID  MODEL  03,  with 
noise  added  to  the  output.  In  particular,  the  system  is  governed 
by  the  equation 

x(t)  +  4x(t)  +  x(t-l)  -  x(t-l)  =  u  ^(t)  , 
with  initial  data 

xQ(s)  =  1  ,  xQ(s)  =0  ,  -1  s  s  s  0  , 

and  (noisy)  output 


X(t) 

vx(t) 

y  (t)  = 

+ 

i(t) 

v2<t) 

where  v^(t)  (i=  1,2)  is  a  computer  simulated  normal  random  var¬ 
iable  with  zero  mean  and  standard  deviations  of  0.1  on  the  position 
data  (v^)  and  0.2  on  the  velocity  data  (v£) • 

The  random  variables  v^(t)  (i  =  1,2)  were  generated  using 
routine  GGNQF  of  the  IMSL  library  (see  IMSL  Users  Guide)  and 
added  to  the  analytic  solution  x(t)  and  x(t)  of  the  delay  equation 
to  produce  data  (y  ,i  ■  1,2, • • *,  101)  at  101  equally  spaced  times 
on  [0,2].  These  values  produced  rather  noisy  data,  which  was  used 
in  following  examples;  04.2  -  04.3. 
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EXAMPIE  04.2 


For  this  example  we  estimate  two  system  coefficients  and  the 
time  delay.  The  model  is  assumed  to  have  the  form 

x(t)  +  4x(t)  +  aQx(t-r)  +  ajX(t-r)  =  u  ^(t)  , 

with  initial  data 


xQ(s)  =  1  ,  Xq (s)  =  0  ,  -r  s  s  s;  0  , 


and  output 


y(t)  = 


x(t) 

x(t) 

L  J 


For  N  =  2,  4,  8  and  16  the  approximating  identification  problem 
was  formulated  and  a  version  of  the  MUE  algorithm  described  in 
[  9 ]  was  used  to  estimate  the  parameters  ag  =  1.0,  a*  =  -1.0  and 
r*  =  1.0.  Start-up  values  for  each  run  were  set  at 


.75 


N,  0 

i  '  s 


=  -.75 


N,0 


.8  . 


Except  for  the  N  =  2  AVE  run,  each  run  converged  to  reasonable 
estimates  for  the  parameters.  Again  the  SPLINE  scheme  produced 
better  results.  The  N  =  16  AVE  estimates  give  about  147.  relative 
error,  while  the  N  =  16  SPLINE  estimates  have  about  17.  relative 
error.  The  convergence  results  for  this  problem  are  summarized 
in  Tables  04.2.1  and  04.2.2. 


1 
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Typical  data  fits  for  this  problem  are  illustrated  in  Figures 
04.2.1  -  04.2.4.  Note  that  the  data  produced  by  adding  the  simulated 
noise  is  indeed  very  "noisy".  However,  at  N  =  8  both  AVE  and  SPLINE 
do  a  "good"  job  of  fitting  the  data.  In  fact,  the  N  *  8  converged 


data  fits  provide  nearly  perfect  matches  to  the  system  outputs  with¬ 
out  the  noise. 


AVE 

N 

-N 

*N 

-N 

leu! 

ao 

31 

r 

1  N’ 

2 

773.3040 

-.9699 

65.6704 

837.0045 

4 

2.2051 

-.9832 

1.8078 

2.0297 

8 

1.3959 

-.9947 

1.2547 

.6559 

L6 

.7740 

-1.0664 

1.1142 

.4066 

Y*  ** 

1.0000 

-1.0000 

1.0000 

TABLE  04.2.1 


SPLINE 

N 

-N 

ao 

al 

-N 

r 

Icn1 

2 

1.0813 

-1.0254 

.8233 

.2834 

4 

1.0001 

-1.0283 

.9533 

.0751 

8 

.9881 

-1.0195 

.9937 

.0377 

16 

.9850 

-1.0156 

1.0013 

.0319 

Y*  = 

1.0000 

-1.0000 

1.0000 

TABLE  04.2.2 
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In  this  problem  all  of  the  system  coefficients  and  the  time 
delay  are  estimated.  In  particular  the  model  is  assumed  to  have 
the  form 


x(t)  +  <u  x(t)  +  aQx(t-r)  +  ajX(t-r)  =  u  ^(t)  , 


with  initial  data 


xQ(s)  =  1  ,  xQ(s)  =  0  ,  -r  s  s  i  0  , 


and  vector  output 


y(t)  * 


Start-ups  for  the  true  parameter  uu*  =  2.0,  a*  =  1.0,  a*  *  -1.0, 

0  1 


r*  *  1.0  were  set  at 


N,0  rr-  N,  0  N,0  N,0  _ 

o  =/3,  Sq  =.75,  a^  =  -.75  ,  r  =.8, 


and  runs  were  made  for  N  *  2,  4,  8  and  16. 

For  N  =  2  neither  AVE  nor  SPLINE  converged.  At  N  *  4  the  AVE 
scheme  converged.  However,  the  N  =  4  M1E  procedure  for  the  SPLINE 
approximation  never  really  converged.  The  Ml£  algorithm  produced  a 
sequence  of  parameters  that  oscillated  between  two  values.  These 
two  values  are  displayed  in  Table  04.3.2.  Observe  that  either  of 


> 


the  two  parameter  estimates  obtained  by  the  SPLINE  scheme  Is 
better  than  the  AVE  estimate  •  At  N  *  8  both  AVE  and  SPLINE  con¬ 
verged,  while  at  N  =  16  the  SPLINE  procedure  again  produced  two 
values  for  each  parameter  and  the  MLE  algorithm  oscillated  between 
these  values. 

The  data  fits  for  this  example  are  typical  of  the  previous 
examples.  Figures  04.3.1  -  04.3.4  illustrates  the  N  =  8  converged 
data  fits.  The  data  fits  at  N  *  16  for  AVE  and  SPLINE  are  almost 
the  same,  and  for  the  SPLINE  scheme  either  of  the  two  parameters 
given  in  Table  04.3.2  produces  essentially  the  same  data  fits. 


AVE 

N 

JN  ~N 

fo 

s 

K1 

2 

did  n  n  f 

C  o  n  v  P  r  o  p 

4 

1.6475  -2.2109 

^  w  u  v  c  1  B  c 

.1635 

.8603 

4.7269 

8 

1.8221  1.6184 

-.4164 

.8807 

1.3799 

16 

1.7647  1.2959 

-.3349 

.7405 

1.1963 

Y*  = 

2.0000  1.0000 

-1.0000 

1.0000 

TABLE  04.3.1 
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SPLINE 


N 

aN 

a' 

~N 

a0 

-N 

al 

r 

leN> 

2 

did 

not 

converge 

4 

2.1246 

.6354 

-1.4428 

1.4526 

1.3846 

4 

2.1191 

.6633 

-1.4263 

1.4161 

1.2982 

8 

1.9671 

1.0641 

-  .9164 

.9381 

.2425 

16 

1.9436 

1.1155 

-  .8410 

.9074 

.4235 

16 

1.9736 

1.0529 

-  .9373 

.9573 

.1847 

* 

ii 

2.0000 

1.0000 

-1.0000 

1.0000 

TABUS  04.3.2 


FIGURE  04.3.3 
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_ ID  MODEL  05 _ 

This  model  is  Che  second  order  oscillator  considered  in  ID 
MODEL  01,  with  vector  output.  However,  data  was  generated  on  a 
longer  time  interval  by  numerically  integrating  the  equations.  In 
particular,  the  system  is  governed  by  the  delay  equation 

x(t)  +  36x(t)  +-  2.5x(t-l)  +  9x(t-l)  =  u  ^ ( t )  , 

with  initial  data 


xQ(s)  =  1  ,  xQ(s)  =  0  ,  -1  <  s  <  0 


and  vector  output 


y(t)  - 


This  system  was  numerically  integrated  (using  a  modified  4th  order 
scheme)  to  obtain  the  solution  on  the  interval  [0,5].  Data  was 
generated  at  101  equally  spaced  points  (i.e.  20  data  points  per 
unit  interval)  using  this  numerical  solution. 

As  a  rough  check  of  the  numerically  produced  data,  the 
numerical  solution  and  the  analytic  solution  were  compared  on  the 
Interval  [0,2].  The  numerical  solution  agreed  exactly  (i.e.  to 
eight  decimal  places)  with  the  analytic  solution,  giving  some  in¬ 
dication  that  the  data  for  this  model  is  reasonably  good. 
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As  a  final  comnent,  we  mention  that  the  numerical  algorithm 
used  to  integrate  the  delay  equation  is  completely  unrelated  to 
any  of  the  approximation  schemes  used  in  the  identification 
algorithms.  Consequently,  we  are  not  using  data  generated  by  the 
algorithm  that  we  are  attempting  to  study. 


i 

( 

I 


f 
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EXAMPLE  05.1 

For  this  example  we  seek  to  estimate  the  time  delay  and  two 
system  coefficients.  The  model  is  assumed  to  be  of  the  form 

x(t)  +  36x(t)  +  aQx(t-r)  +  a^Ct-r)  =  u  x(t)  , 
with  initial  data 

Xq (s)  1  ,  xQ(s)  s  0  ,  -r  s  s  S  0  , 

and  vector  output 


y(t)  = 


x(t) 


x(t) 


Recall  that  in  this  example  we  have  data  generated  for  5  seconds, 
i.e.  on  the  interval  [0,5],  at  101  points.  The  parameters  to  be 
estimated  are  r*  =  1.0,  ag  =  2.5  and  a*  =  9.0.  Start-up  values 
for  each  run  were 


r 


N,  0 


2.2 


N,  0 

•x  ' 


9.5  . 


Other  start-up  values  were  attempted  and  the  algori  hms  were  found 
to  diverge  if  the  start-up  errors  were  too  large  and  in  some  cases 
the  algorithms  converged  to  parameters  different  than  r*,  ag,  a*. 
This  again  shows  that  there  can  be  a  lack  of  global  identif iability 


Runs  for  N  =  2,  4,  8  and  16  were  made  for  both  AVE  and  SPLINE. 
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For  low  N,  the  AVE  scheme  did  not  converge.  However,  both  AVE  and 
SPLINE  converged  for  larger  N  and  produced  reasonable  estimates  of 
the  parameters.  These  results  are  summarized  in  Tables  05.1.1  and 
05.1.2.  Observe  that  at  N  =  16  the  SPLINE  procedure  produced 
estimates  with  approximately  27.  relative  ll  error,  while  the  N  =  16 
AVE  estimates  have  relative  error  greater  than  227.. 

The  data  fits  for  this  example  are  very  interesting.  This 
example  is  very  dynamic  and  oscillatory  on  the  interval  [0,5]. 
However,  at  N  »  16  both  AVE  and  SPLINE  produce  fairly  good  data 
fits,  with  the  SPLINE  scheme  matching  the  data  better  than  AVE. 
Figures  05.1.1  -  05.1.4  show  the  iteration  0  and  converged  data 
fits  for  the  AVE  scheme.  Figures  05.1.5  -  05.1.8  illustrate  the 
same  thing  for  the  SPLINE  procedure. 


AVE 

N 

rN 

aN 

a0 

-N 

31 

Kl 

2 

did 

not  conve 

r  g  e 

— 

4 

did 

not  conve 

r  g  e 

— 

8 

.2492 

2.8002 

-  3.8982 

13.9492 

16 

.9106 

1.7439 

10.9570 

2.8025 

y*  ■ 

1.0000 

2.5000 

9.0000 

TABLE  05.1.1 
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SPLINE 

-N 

*  N 

N 

r 

ao 

al 

IcnI 

2 

did 

not  conve 

r  g  e 

4 

.6812 

-2.3261 

11.7017 

7.8466 

6 

.9985 

2.9163 

8.9459 

.4719 

16 

1.0000 

2.6016 

9.0872 

.1888 

Y*  = 

1.0000 

2.5000 

9.0000 
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ID  MODEL  Kl 

This  is  a  model  with  continuous  kernel.  The  system  is  governed 
by  the  equation 

x(t)  =  -3x(t-l)  -  J*®  x(t+s)ds  +  u  ^(t) 


with  initial  data 


xQ(s)  si,  -1  &  s  £  0  , 


and  output 


y (t)  =  x(t)  . 


This  equation  can  be  transformed  to  a  system  of  two  equations  with 
no  integral  term  (see  pages  63-64  of  [ 9  ])  and  solved  using  the 
method  of  steps.  The  analytic  solution  was  obtained  by  this  pro¬ 
cedure  and  data  was  generated  at  101  equally  spaced  points  on  [0,2]. 
This  data  was  used  in  the  following  examples;  Kl.l,  K1.4. 
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EXAMPLE  Kl.l 


In  this  example  we  attempt  to  identify  the  kernel  by  assuming 
that  it  is  constant  function  with  unknown  value.  Therefore,  the 
model  is  of  the  form 

x(t)  =  -3x(t-l)  +  k  x(t+s)  ds  +  u  .  (t)  , 

-1 

with  initial  data 


xQ(t)  =1  ,  -1  *  s  £  0  , 


and  output 


y (t)  =  x (t)  . 


The  constant  k*  =  -1.0  is  to  be  estimated.  Runs  at  N  *  2,4,8,16 
were  made  with  the  start-up  of 


This  example  is  interesting  for  several  reasons.  It  is  an 
example  that  contains  a  distributed  delay  and  it  is  the  only 
example  we  have  run  where  the  AVE  scheme  produced  better  parameter 
estimates  than  the  SPLINE  scheme.  Table  Kl.1.1  illustrates  the 
convergence  of  the  parameter  estimates  for  AVE  and  SPLINE.  Figures 
Kl.1.1  and  Kl.1.2  compare  the  N  =  8  converged  data  fits  for  AVE  and 
SPLINE,  respectively.  Observe  that  even  though  the  N  ■  8  AVE  scheme 
produced  a  better  parameter  estimate,  the  N  ■  8  SPLINE  scheme  does  a 

l 
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I  much  better  job  of  fitting  the  data. 


AVE 

SPLINE 

f - 

N 

k* 

leNl 

N 

kN 

2 

-1.2953 

.2953 

2 

-1.2679 

.2679 

4 

-1.0765 

.0765 

4 

-1.0827 

.0827 

8 

-1.0156 

.0156 

8 

-1.0301 

.0301 

16 

-1.0058 

.0058 

16 

-1.0177 

.0177 

k* 

=  -1.0000 

k* 

• 

=  -1.0000 

TABLE  Kl.1.1 


I 

I 


EXAMPLE  K1.4 


In  this  example  we  estimate  two  system  coefficients  and  the 
time  delay.  As  before,  the  kernel  is  estimated  by  assuming  that 
it  is  an  unknown  but  constant  function.  Therefore,  the  model  is 
assumed  to  be  of  the  form 

x(t)  =  a^x(t-r)  +  k  ^  x(t+s)  ds  +  u  ^(t)  , 

-r 

with  initial  data 


and  output 


Xq(s)  =  1  ,  -r  £  s  £  0 


y(t)  =  x ( t )  . 


The  true  parameters  a*  *  -3.0,  k*  -  -1.0  and  r*  *  1.0  we  estimated 
using  start-ups  of 


-3.5 


N,  0 


-1.5 


N,0 


1.5  . 


Runs  were  made  for  N  =  2,4,8  and  16.  The  AVE  scheme  did  not  con¬ 
verge  for  N  =  2  and  4.  However,  for  N  *  8  and  16  the  AVE  scheme 
converged  but  produced  rather  poor  parameter  estimates.  The  SPLINE 
scheme  converged  for  each  N  =  2,4,8,16  and  for  N  i  4  produced  good 
parameter  estimates.  The  numerical  results  for  this  problem  are 
summarized  in  Tables  Kl.4.1  and  Kl.4.2. 

Figures  Kl.4.1-  Kl.4.4  compare  the  N  ■  8  AVE  and  SPLINE  data 


fits.  In  particular.  Figures  Kl.4.1  and  KI.4.2  show  the  N  =  8  AVE 
start-up  and  converged  data  fits,  respectively.  Figures  Kl.4.3 
and  KI.4.4  show  the  same  thing  for  the  SPLINE  procedure. 


N 

-N 

r 

kN 

aN 

al 

leNl 

2 

did  not 

converge 

4 

did  not 

converge 

8 

.8802 

.2182 

-4.1641 

2.0657 

16 

.9383 

-.3806 

-3.5535 

1.2346 

| 

Y* 

= 

1.0000 

-1.0000 

-3.0000 

TABLE  Kl.4.1 


SPLINE 

N 

r 

pN 

k 

al 

|eN| 

2 

.9100 

-  .4376 

-3.4478 

1.1002 

4 

.9896 

-1.0087 

-3.0580 

.0771 

8 

1.0018 

-1.0390 

-2.9953 

.0455 

16 

1.0042 

-1.0410 

-2.9841 

.0611 

Y*  ■ 

1.0000 

-1.0001 

-3.0000 

TABLE  Kl.4.1 


Y  ( 1) 
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Summary  Remarks 

The  major  lesson  of  our  experience  with  the  AVE  and  SPLINE 
identification  procedures  is  that  SPLINE  is  generally  superior  and 
commonly  displays  near  quadratic  convergence.  It  has  been  observed 

N 

that  the  error  function  E  can  have  multiple  relative  minima.  In 

order  to  solve  the  1DN  problem  we  have  used  a  maximum  likelihood 

estimator  (MLE),  which  in  the  case  of  a  scalar  measurement,  is 

equivalent  to  the  usual  quasi-linerization  (QL)  procedure  for 
N 

minimizing  E  .  Conditions  that  guarantee  convergence  of  the  QL 
procedure  are  rather  stringent  (see  [7])  and,  in  fact,  are  not 
satisfied  in  our  examples.  In  applications  it  would  seem  prudent 
to  employ  a  hybrid  algorithm  for  the  LDN  problem,  wherein  one 
would  initially  use  a  method  that  guarantees  descent  and  then 
employ  QL  only  in  the  neighborhood  of  a  minimizing  point. 
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The  optimal  ccntrol  problem:  numerical  examples. 


In  this  section  we  present  numerical  results  for  a  number  of 

examples  of  the  optimal  control  problem  (OC) .  The  two  schemes 

AVE  and  SPLINE  were  employed  to  compute  approximating  optimal 

controls  u  and  u„  for  several  values  of  N  chosen  to  illustrate 
A  S 

convergence  properties.  The  linear  systems  examples  given  here 
are  essentially  the  same  as  some  of  the  examples  considered  in 
detail  in  [6  ].  For  these  examples  the  analytic  solution  u*  of  the 
optimal  control  problems  can  be  found  in  §3  of  that  report  and  we 
shall  not  redrive  those  solutions  here.  Only  one  (C8)  of  the 
linear  examples  presented  below  was  not  considered  specifically 
in  [  6  ] however  for  the  particular  case  detailed  here  the  optimal 
control  can  be  computed  by  using  the  maximum  principle  for  delay 
systems  in  the  same  manner  as  was  done  for  Example  10  of  [  6  ]. 

Since  the  report  [ 6  ]  is  rather  complete  and  easily  obtained,  we 
shall  feel  free  to  use  the  results  presented  in  that  technical 
report  without  elaborate  comment  or  discussion.  For  the  motivation 
behind  our  choice  of  some  of  the  particular  examples  presented 
here  and  in  [6],  the  interested  reader  can  consult  [6]. 

We  also  present  below  our  numerical  findings  for  two  nonlinear 
examples.  The  theory  for  use  of  the  AVE  approximations  with  a 
restricted  but  reasonable  class  of  nonlinear  system  optimal  control 
problems  is  developed  in  [1].  Consideration  of  the  arguments  given 
there  along  with  details  of  the  SPLINE  scheme  development  in  [  8  ] 
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should  convince  the  reader  that  a  corresponding  theory  for  the 
SPLINE  scheme  can  be  developed  in  a  straightforward  manner. 


i 
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EXAMPLE  Cl 

The  first  system  is  given  by  the  scalar  equation 
x(t)  *  x (t  -  1)  +  u (t)  ,  0  <;  t  £  3 

with  initial  data 

x(s)  =  1,  -1  5  s  s  0  , 

and  the  payoff  is  chosen  as 

3 

J(u)  =  5[x(3)]2  +■  \  C  [u(s)]2  ds  . 

J0 

The  optimal  control  u*  is  given  by  (see  page  11  in  [ 6  ] 

'  2 

6{-<t  -  2)  /2  -  3/2],  0  s  t  *  1, 
u*(t)  =  6(t  -  3)  ,  1  5  t  s  2 

-6  ,  ?  4,  t  s  3, 

where  6  *  370/{6(l  *-319/3)}  .5745.  The  optimal  cost  is 

J*  -  J(u*)  -  1.7715  . 

Table  (Cl.l)  compares  J  and  J*  for  each  of  the  two  schemes 

AVE  and  SPLINE.  The  example  is  somewhat  typical  in  that  (as 
one  might  expect  from  theoretical  investigations  -  both  methods  are 

basically  first  order,  but  the  estimates  for  SPLINE  indicate  that 
one  should  expect  slightly  faster  convergence  for  this  scheme) 
SPLINE  converges  faster  than  AVE.  Note  that  the  error  for  SPLINE 
at  N  =  4  is  less  than  the  error  for  AVE  at  N  *  32. 
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Table  (CL. 2)  contains  the  CPU  times  for  each  run  of  the 
conjugate-gradient  algorithm.  As  shown,  the  time  to  make  each  run 
is  very  reasonable  for  both  schemes,  although  SPLINE  requires 
slightly  more  time  per  run.  These  times  were  typical  for  all  the 

scalar  examples. 

N  »  N 

Tables  (Cl. 3)  and  (Cl. 4)  compare  the  controls  uA  and  ug  to  u* 
for  N  =  4,  8,  16,  32.  We  observe  that  SPLINE  provides  a  better 
approximation  to  u*  than  AVE.  It  is  interesting  to  note  that  SPLINE 
is  not  as  monotone  in  its  convergence  as  AVE. 


J 


4  1.72491  .0466 

8  1.74750  .0240 

16  1.75939  .0121 

32  1.76551  .00599 

J*  =  1.7715 


SPLINE 

N 

JN 

4 

1.77320 

.0017 

8 

1.77179 

.00029 

16 

1.77164 

.00014 

32 

1.77139 

.00009 

J* 

=  1.7715 

TABLE  Cl.l 


AVE 

SPLINE 

N 

CPU  Sec 

N 

CPU  Sec 

4 

23.8 

4 

30.6 

8 

28.9 

8 

39.1 

16 

39.1 

16 

59.5 

32 

56.1 

32 

93.5 

TABLE  Cl. 2 
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I 


AVE 

time 

-  4 
u 

-  8 
u 

- 16 
u 

a32 

u* 

0.00 

-2.0050 

-2.0067 

-2.0075 

-2.0086 

-2.0108 

0.25 

-1.7340 

-1.7386 

-1.7400 

-1.7405 

-1.7450 

0.50 

-1.4994 

-1.5069 

-1.5092 

-1.5092 

-1.5081 

0.75 

-1.2962 

-1.3064 

-1.3112 

-1.3124 

-1.3106 

1.00 

-1.1197 

-1.1317 

-1.1402 

-1.1448 

-1.1500 

1.25 

-0.9662 

-  .9774 

-  .9877 

-  .9955 

-1.0054 

1.50 

-  .8335 

-  .8397 

-  .8463 

-  .8527 

-  .8618 

1.75 

-  .7214 

-  .7201 

-  .7170 

-  .7151 

-  .7181 

2.00 

-  .6324 

-  .6272 

-  .6179 

-  .6082 

-  .5745 

2.25 

-  .5708 

-  .5720 

-  .5708 

-  .5706 

-  .5745 

2.50 

-  .5385 

-  .5527 

-  .5623 

-  .5683 

-  .5745 

2.75 

-  .5291 

-  .5504 

-  .5621 

-  .5683 

-  .5745 

3.00 

-  .5286 

-  .5504 

-  .5621 

-  .5683 

-  .5745 

TABLE  Cl. 3 


•U  -L  *-*!*-  tl 
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EXAMPLE  C2 

In  this  control  problem,  which  Is  the  same  rs  Example  3B  ot 
6  ,  we  take  as  our  system  the  scalar  equal  ion 

x ( t )  =  ^  x(t-l)  +  u(t)  ,  0  ■£.  t  S  2 

with  initial  data 

x(s)  =  1  ,  -1  £  s  S  o  . 

The  payoff  is  given  by 

2 

J(u)  =  ^[x(2)]2  +  k  V  [u(s)]2  ds  . 

Jo 

The  optimal  control  is  given  by  (see  page  56  in  [  6]) 

(  6[(TT/2)(l-t)  +  1]  ,  0  t  t  s  1  , 

u*(t)  -  / 

6  ,  1  s  t  s  2  , 

k 

where  6  ^  -  .9967  (see  page  12  of  [  6  ])  and  the  optimal  cost  is 

J*  =  J(u*)  -  2.6787  . 

N 

Table  (C2.1)  summarizes  the  convergence  properties  of  J  to 

J*  and  compares  the  AVE  and  SPLINE  schemes.  Again  we  observe  an 

improvement  by  using  the  SPLINE  scheme.  Tables  (C2.2)  and  (C2.3) 

contain  the  control  values  for  AVE  and  SPLINE.  A  graphical 

comparison  of  u  ,  u  and  u*  is  presented  in  Figure  C2.1. 

A  S 
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AVE 

SPLINE 

N 

JN 

|}N-J*| 

N 

JN 

4 

2.6765 

.0022 

4 

2.6827 

.0040 

8 

2.6891 

.0104 

8 

2.6801 

.0014 

16 

2.6894 

.0107 

16 

2.6792 

.0005 

32 

2.6864 

.0077 

32 

2.6790 

.0003 

J*  =  2.6787 

J*  =  2.6787 

TABLE  C2.1 


AVE 


! - 

-4 

-8 

~  16 

~32 

u* 

u 

u 

u 

u 

0.00 

-2.6371 

-2.6122 

-2.5962 

-2.5834 

-2.5623 

0.25 

-2.1679 

-2.1568 

-2.1583 

-2.1629 

-2.1709 

0.50 

--1.7783 

-1.7653 

-1.7645 

-1.7703 

-1.7795 

0.75 

-1.4593 

-1.4324 

-1.4086 

-1.3933 

-1.3881 

1.00 

-1.2112 

-1.1762 

-1.1363 

-1.1005 

-  .9967 

1.25 

-1.0410 

-1.0240 

-1.0069 

-  .9975 

-  .9967 

1.50 

-  .9521 

-  .9709 

-  .9837 

-  .9910 

-  .9967 

1.75 

-  .9263 

-  .9646 

-  .9831 

-  .9910 

-  .9967 

2.00 

-  .9248 

-  .9645 

-  .9831 

-  .9910 

-  .9967 

TABLE 

C2.  2 
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SPLLNE 


8 

-  16 

,  32 

u* 

time 

u 

u 

u 

u 

0.00 

-2.5732 

-2.5679 

-2.5643 

-2.5626 

-2.5623 

0.25 

-2.1750 

-2.1652 

-2.1725 

-2.1708 

-2.1709 

0.50 

-1.7649 

-1.7858 

-1.7822 

-1.7789 

-1.7795 

0.75 

-1.3669 

-1.3778 

-1.3927 

-1.3871 

-1.3881 

1. 00 

-1.0907 

-1.0465 

-1.0236 

-1.0129 

-  .9967 

1.25 

-  .9986 

-  .9966 

-  .9976 

-  .9968 

-  .9967 

1.50 

-1.0102 

-  .9987 

-  .9974 

-  .9968 

-  .9967 

1.75 

-  .9904 

-1.0028 

-  .9968 

-  .9968 

-  .9967 

2.00 

-  .8955 

-  .9409 

-  .9672 

-  .9815 

-  .9967 

TABLE  C2.3 
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EXAMPLE  C3 


In  this  example  the  system  is  two  dimensional  and  is  described 


by 


_d 

dt 


Xj  (t) 


x2  (t) 


0  1 


0  0 


xL(t) 


x2(t) 


0  0 


0  -1 


(t-1) 


x2 (t-1) 


u  ( t ;  , 


where  0  4  t  4  2  and  the  initial  data  is  chosen  as 


—  ~i- 

X.  (s) 

1 

10 

x„  (s) 

0 

2 

_ 

,  1  4  s  4  0. 


The  cost  functional  is  given  by 

2 


J  (u) 


=  h  C x,  (2) ]  +■  %  C  [u(s)]  ds 

Jr, 


This  system  is  equivalent  to  the  second  order  equation  (see  Example 
5  in  [6  ]) 


y(t)  +  y(t-l)  =  u(t), 

where  x^(t)  =  y(t)  and  x^t)  =  y(t).  The  optimal  control  is  given 

by  (see  pages  18  and  66  of  [6  ]) 

/ 

(c/2)  (3  -  t2)  ,  0  &  t  s  1, 

u*(t)  -  < 

6(2  -  t )  ,  1  4  t  4  2, 

where  6  —  -3.1915,  and  the  optimal  cost  is 
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J*  =  J  (u*)  15.9574  . 


:n 


Table  C3.1  illustrates  the  convergence  of  J  to  J*  for  AVE 
and  SPLINE.  It  is  interesting  to  compare  the  CPU  times  (Table  C3.2) 
for  this  two  dimensional  example  with  Table  (Cl.  2)  for  the  scalar 


problem.  Example  Cl.  Note  that  the  total  CPU  time  increased  only  a 


~N  „N 

lew  seconds.  Tables  (C3.3)  and  (C3.4)  compare  and  to  u* . 


~32 

Note  that  is  almost  identical  (to  3  places)  to  u*! 


AVE 

SPLINE 

N 

JN 

.-'N 

|J  -J*| 

N 

JN 

PN-J*| 

4 

17.3450 

1.3876 

4 

16.0149 

.0575 

8 

16.7215 

.7641 

8 

15.9721 

.0147 

16 

16.3604 

.4030 

16 

15.9618 

.0044 

32 

16.1649 

.2075 

32 

15.9594 

.0020 

J* 

=  15.9574 

J*  = 

15.9574 

TABLE  C3.1 
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— 

AVE 

SPLINE  j 

N 

CPU  Sec 

N_ 

- 1 

CPU  Sec 

4 

25.5 

4 

28.9 

8 

28.9 

8 

40.8 

16 

34.0 

16 

62.9 

32 

54.4 

32 

105.4 

TABLE  C3.2 


:  AVE  1 

l - - - .  1 


time 

-4 

-8 

.16 

.32 

u 

u 

u 

u 

u* 

— 

* - * 

- - 

— 

— 

0.00 

-4.8886 

-4.8486 

-4.8210 

-4.8044 

-4.7872 

0.25 

-4 . 7369 

-4.7186 

-4.7063 

-4.6982 

-4.6875 

0.50 

-4.4217 

-4.4065 

-4.3988 

-4.3947 

-4.3883 

0.75 

-3.9406 

-3.9124 

-3.8976 

-3.8919 

-3.8896 

1.00 

-3.3083 

-3.2590 

-3.2275 

-3.2099 

-3.1915 

1.25 

-2.5562 

-2.4926 

-2.4499 

-2.4239 

-2.3936 

1.50 

-1.72  79 

-1.6711 

-1.6359 

-1.6164 

-1.5957 

1.75 

-  .8670 

-  .8360 

-  .8180 

-  .8082 

-  .7979 

2.00 

0.00 

0.00 

0.00 

0.00 

0.00 

TABLE  C3.3 
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SPLINE 


time 

/s4 

u 

00 

<3 

TV  16 

u 

/s32 

u 

u* 

0.00 

-4.8629 

-4.8047 

-4.7918 

-4.7885 

-4.7872 

0.25 

-4.7443 

-4.7024 

-4.6908 

-4.6884 

-4.6875 

0.50 

-4.4094 

-4.3940 

-4.3906 

-4.3889 

-4.3883 

0.75 

-3.8599 

-3.8852 

-3.8880 

-3.8893 

-3.8896 

1.00 

-3.1497 

-3.1794 

-3.1883 

-3.1906 

-3.1915 

1.25 

-2.3598 

-2.3835 

-2.3909 

-2.3930 

-2.3936 

1.50 

-1.5463 

-1.5829 

-1.5925 

-1.5950 

-1.5957 

1.75 

-  .7381 

-  .7834 

-  .7942 

-  .7970 

-  .7979 

2.00 

0.00 

0.00 

0.00 

0.00 

0.00 

TABLE  C3.4 
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EXAMPLE  C4 


Consider  now  the  three  dimensional  system 


r  xi(t> 

~0 

1 

o'1 

X]L(t-i) 

0 

i  i  x2(t) 

0 

0 

1 

i 

1 

1 

x2(t-l) 

+ 

0 

i  *3^) 
i_  — 

0 

0 

- 1 

O 

x3(t-l) 

1 

on  the  interval  0  £  t  £  3.  We  choose  as  initial  function  the 
constant  vector 


Xl(s) 

f  10 

*2(s) 

=  !  0 

x3(s) 

i 

,  0 

L  _J 

and  the  cost  is  defined  by 

2  (-■*  2 

J(u)  =  (.OSJfxj.O)]  +  k  \  [u(s)]  ds  . 

J0 


This  is  the  same  problem  as  Example  6  in  the  report  [6  ].  The 
optimal  control  is  found  to  be  (see  page  70  of  [ 6  ]) 


u*(t)  = 


6  (1  -  t)2 


0.0 


0  £  t  £  1  , 
1  £  t  £  3  , 


where  6  —  -.4975,  and 


J*  --  4.9751 

A  numerical  summary  for  this  problem  is  presented  in  Table 
(C4. 1)-(C4.4)  and  Figure  (C4.1).  The  total  CPU  time  is  quite 
reasonable,  even  for  this  3  dimensional  system.  Note  that  for 


— ....  . 
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AVE 


mm  1 

*4 

.8 

.16 

.32 

u 

u 

u _ 

u _ 

u* 

0.00 

-.7201 

-.6159 

-.5577 

-.5274 

-.4975 

0.25 

-.4914 

-.3958 

- . 3402 

-.3102 

-.2798 

0.50 

-.3153 

-.2326 

-.1830 

- . 1548 

- . 1244 

0.75 

-.1871 

-.1212 

-.0819 

-.0591 

-.0311 

1.00 

- . 1002 

-.0537 

-.0281 

-.0145 

0.0 

1.25 

-.0469 

-.0190 

-.0065 

-.0017 

0.0 

1.50 

-.0183 

-.0049 

- . 0009 

-.0001 

0.0 

1.75 

-.0055 

- . 0008 

0.00 

0.00 

0.0 

2.00 

-.0011 

-.0001 

0.00 

0.00 

0.0 

2.25 

-.0001 

0.00 

0.00 

0.00 

0.0 

2.50 

0.00 

0.00 

0.00 

0.00 

0.0 

2.75 

0.00 

0.00 

0.00 

0.00 

0.0 

3.00 

0.00 

0.00 

0.00 

0.00 

0.0 

TABLE  C4.3 
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SPLINE 


time 

~4 

u 

*8 

u 

-16 
u _ 

C> 

u> 

to 

u* 

0.00 

-.4932 

-.4961 

-.4966 

-.4968 

-.4975 

0.25 

-.2767 

-.2791 

-.2793 

-.2794 

-.2798 

0.50 

-.1256 

-.1245 

-.1242 

-.1242 

-.1244 

0.75 

-.0397 

-.0322 

-.0313 

-.0311 

-.0311 

1.0  0 

-.0052 

-.0016 

-.0005 

- . 0002 

0.00 

1.25 

-.0015 

-.0003 

0.00 

0.00 

0.00 

1.50 

- . 0005 

0.00 

0.00 

0.00 

0.00 

1.75 

-.0001 

0.00 

0.00 

0.00 

0.00 

2.00 

0.00 

0.00 

0.00 

0.00 

0.00 

2.25 

0.00 

0.00 

0.00 

0.00 

0.00 

2.50 

0.00 

0.00 

0.00 

0.00 

0.00 

2.75 

0.00 

0.00 

0.00 

0.00 

0.00 

3.00 

0.00 

0.00 

0.00 

0.00 

0.00 

TABLE  C4.4 
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! 

1  time 

~4 

„8 

-16 

-32 

U1 

U1 

U1 

U1 

uf 

i 

0.00 

-1.0250 

-1.0383 

-1.0489 

-1.0546 

-1.0598 

0.25 

-  .8239 

-  .8261 

-  .8320 

-  .8368 

-  .8418 

S  0.50 

-  .6342 

-  .6219 

-  .6181 

-  .6195 

-  .6239 

0.75 

-  .4639 

-  .4373 

-  .4188 

-  .4087 

-  .4060 

1.00 

-  .3236 

-  .2919 

-  .2656 

-  .2449 

-  .1880 

1.25 

-  .2248 

-  .2051 

-  .1927 

-  .1872 

-  .1880 

1.50 

-  .1725 

-  .1748 

-  .1797 

-  .1836 

-  .1880 

1.75 

-  .1574 

-  .1712 

-  .1793 

-  .1836 

-  .1880 

2.00 

-  .1564 

-  .1711 

-  .1793 

-  .1836 

-  .1880 

TABLE  C5.2 


TABLE  C5.3 


EXAMPLE  C6 


We  consider  a  control  problem  with  system  given  by  the  scalar 
equat ion 

x(t)  =  x(t)  +  x(t  -  1)  +  u(t),  0  £  t  £  2, 

and  initial  data 


x(s)  1 


-1  •£  S  £  0 


The  cost  function  is  defined  by 


J(u )  =  I  [x(2)]2  T  k  \  [u(s)]2  ds 


The  optimal  control  (see  Example  4  on  pages  14  and  63  in  [  6  ])  is 
given  by 


u*(t)  = 


6  [e2~tl  +  (1  -  t)e1"t]  ,  0  s  t  s  1 


6  e 


2-t 


,  1  <;  t  s  2  , 


where 


-.3932  and 


J*  3.1017  . 

The  numerical  results  for  this  example  are  summarized  in  Tables 
(C6 . 1) - (C6 .3) .  Observe  again  that  the  SPLINE  scheme  gives  better 
approximations  to  the  payoff  and  control  than  AVE . 


1 
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AVE 

SPLINE 

N 

JN 

N 

f 

|JN-J*I 

4 

3.0084 

.0933 

4 

3.1108 

.0092 

8 

3.0554 

.0462 

8 

3.1047 

.0031 

16 

3.0797 

.0219 

16 

3.1030 

.0013 

32 

3.0915 

.0101 

32 

3 . 1026 

.0009 

J*  = 

3. 1017 

J* 

3.1017 

TABLE  C6.1 

AVE 

time 

^4 

-8 

- 16 

CM 

< 

u* 

u 

u 

u _ 

u _ 

0.00 

-3.9668 

-3.9702 

-3.9726 

-3.9734 

-3.9742 

0.25 

-2.8512 

-2.8662 

-2.8754 

-2.8807 

-2.8870 

0.30 

-2.0497 

-2.0672 

-2.0759 

-2.0808 

-2.0863 

Hi 

-1.4759 

-1.4917 

-1.4964 

-1.4968 

-1.4986 

1 - 

-1.0684 

-1.0843 

-1.0883 

-1.0868 

-1.0688 

1.25 

-  .7835 

-  .8042 

-  .8154 

-  .8221 

-  .8324 

1.50 

-  .5876 

-  .6136 

-  .6298 

-  .6389 

-  .6483 

1.75 

-  .4517 

-  .4765 

-  .4904 

-  .4975 

-  .5049 

2.00 

-  .3515 

-  .3711 

-  .3819 

-  .3875 

-  .3932 

TAB1J-;  06.2 


1 


63- 


SPLINE 


t  i.HK 

U 

-8 

u 

^16 

u 

-32 

u 

u* 

' 

0 .  ou 

-3.9/17 

-  3.973  7 

-3.9735 

-3.9733 

-3.9742 

0 . 2  5 

-  '  ->695 

-2.8854 

-2.8870 

-2.8864 

-2.8870 

0.50 

2  o» ;  i 

-2.0894 

-2.0871 

2.0858 

-2.0863 

0.7  3 

- 1 .  Tool 

- i .4408 

-1.4998 

-1.4981 

-1.4986 

1 .00 

-  I . 0949 

-  i  .0821 

-1.0757 

-1.0728 

-1.0688 

1.25 

-  .8330 

-  .8326 

-  .8326 

-  .8323 

-  .8324 

L .  50 

-  .6535 

-  .6488 

-  .6484 

-  .6482 

-  .6483 

1.75 

-  .5012 

-  .5070 

-  .5048 

-  .5048 

-  .5049 

-  .3590 

-  .3727 

-  .3819 

-  .3872 

-  .3932 

TABLE  C6.3 
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EXAMPLE  C7 


This  example  is  an  interesting  two  dimensional  problem  for 
which  the  SPLINE  scheme  is  clearly  superior  to  the  AVE  scheme.  It 
is  the  same  as  Example  9  in  [  6 ] .  The  equation  is 


x^t) 

“o 

r 

x^t) 

0 

0 

Xj^Ct-l) 

0 

_d_ 

= 

+ 

dt 

x,;  (t) 

-1 

0 

x2(t) 

0 

-1 

x2 (t-1) 

1 

—  _ 

L_ 

-J 

_ 

— 

1_  -J 

_  — 

where  0  £  t  ^  2,  and  the  initial  condition  is  given  by 


r-  ~ 

Xj^fs) 

10 

x2(s) 

0 

_  . — 

_  — 

-1  £  s  £  0  . 


The  equation  is  the  vector  formulation  oi  the  second  order  scalar 
equation 


y (t)  +  y (t  -  1)  +  y ( t)  =  u(t)  , 


which  describes  an  harmonic  oscillator  with  delayed  damping.  The 
cost  function  is  given  by 


J(u)  =  5  fx^)]2  +  \  ^  [u(s)]2  ds  . 

'  0 


The  optimal  control  (see  pages  31  and  bl  in  t  6 J )  is  given  by 

6  sin  ( 2  -  t)  +  ~( 1  -  L  )  sin  (t  -  1)  ,  0  j  t  4  1  , 


u*(t)  = 


6  sin  (2  ~  t) 


,  Itti’  , 
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where  c  2.5599.  The  optimal  cost  is 

J*  -  3.3991  . 

This  example  demonstrates  just  how  much  improvement  one  can  obtain 
by  using  the  SPLINE  scheme  in  place  of  AVE. 

In  order  to  check  the  convergence  rates  of  the  two  algorithms, 
we  assume  that 

£n  =  1  JN  -  J*  j  '  K^l/N)3 

and 

=  ',1  *N  -  I!l  -  K2(1/N)P  , 

where  ,  K..^  and  0  are  constants.  The  convergence  rate .  B,  can  be 
used  to  compare  the  two  schemes.  For  example,  an  algorithm  with 
g  -  2.0  provides  faster  convergence  than  an  algorithm  with  g  =  1.0. 
Solving  the  above  equations  for  8,  we  find  that 

2  "  iKgt/£2N'>  ~ 

<k.  2  Zr  2 

Consequently,  g  can  be  estimated  from  the  numerical  results.  Table 

C7.1  indicates  the  computed  value  oi  g  for  J  —  J*.  Note  that  8  is 

approximately  one  for  AVE  and  two  for  SPLINE.  The  values  of 
N 

]u  -  u*  used  in  Table  C7 . 4  were  estimated  by  using  a  simple 
L2 

Euler  scheme  for  the  integration.  Again,  the  convergence  rate  g 
is  approximately  one  for  AVE  and  two  for  SPLINE. 
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1 

1 

1 

AVE 

SPLINE 

- -  1 

r 

N 

3N 

N 

f 

£ 

4 

2.1313 

1.2475 

.78 

4 

3.5354 

.1363 

1.94 

8 

2.6711 

.7280 

.88 

8 

3.4345 

.0354 

1.91 

16 

3.0035 

.3956 

.94 

16 

3.4085 

.0094 

1.7> 

i 

32 

3.1929 

.2062 

— 

32 

3.4019 

.0028 

.... 

J* 

=  3.3991 

_ 

J*  =  3 

.3991 

TABLE  C7.1 


AVE 


time 

~4 

.8 

.16 

.32 

u 

u 

u _ 

u _ 

u* 

0.00 

1 . 0403 

1.1386 

1.1931 

1.2212 

1.2506 

0.25 

1.4574 

1.6371 

1.7451 

1.8038 

1.8645 

0.50 

1.7277 

1.9522 

2.0898 

2.1664 

2.2467 

0.75 

1.8163 

2.0447 

2.1839 

2.2628 

2.3501 

1.00 

1.7136 

1.9110 

2.0259 

2.0882 

2.1541 

1.25 

1.4369 

1.5839 

1.6644 

1.7052 

1.7449 

1.50 

1.0259 

1.1209 

1.1727 

1.1997 

1.2273 

1.75 

.5313 

.5788 

.6052 

.6191 

.6333 

2.00 

0.00 

0.00 

0.00 

0.00 

0.00 

TABLE  C7.2 


6 


SPLINE 


ys4 

-8 

*16 

*32 

u* 

time 

u 

u 

u _ 

u _ 

0.00 

1.3669 

1.2786 

1.2579 

1.2527 

1 . 2506 

| 

0.25 

1.9770 

1.8937 

1.8717 

1.8666 

1.8645 

0.50 

2.3287 

2.2683 

2.2530 

2.2485 

2.2467  [ 

0.75 

2.3805 

2.3611 

2.3527 

2.3511 

2.3501 

2.1609 

2.1552 

2.1545 

2.1543 

2.1541  ' 

1.25 

1.7446 

1.7440 

1.7447 

1.7451 

1 . 7449  1 

i 

1.50 

1.2018 

1.2210 

1.2258 

1.2271 

1.2273 

1.75 

.5902 

.6232 

.6308 

.6328 

.6333 

0.00 

0.00 

0.00 

0.00 

0.00 

TABLE  C7.3 

AVE 

SPLINE  [ 

N 

!!C,n-»*II, 

P 

N 

lia"-»*ll, 

p 

2 

2 

4 

.5650 

.  .95 

4 

.0954 

1.96 

8 

.2931 

.92 

8 

.0245 

1.95 

16 

•  1553 

.97 

16 

.0063 

1.75 

32 

.0795 

— 

32 

.0018 

---- 

TABLE  C7.4 
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EXAMPLE  C8 


Except  tor  the  initial  data  this  problem  is  the  same  as 
Example  10  in  [  b ]  .  The  system  is  described  by  the  two  dimensional 


•cjuat  ion 


xL(t)  ;  0  1 


rx  <t)~|  r0  o-1  fx^t-i)-!  [~o 

i  ! 


e2<t>J  L°  L"  °J 

where  0  4  t  4  2,  and  initial  data  given  by 


e  i  !  u  ( t ) 


x-(t-l)  j  1 

L  j 


x^  (s) 


x2(s)  !  0 


,  -  1  4  S  4  0  . 


The  system  is  the  vector  formulation  of  the  second  order  scalar 


equation 


y(t)  +  y(t)  +  y(t-l)  =  u(t)  . 


The  payoff  is  taken  to  be 


1  0  x.  (2) 


J(u)  =  J5{[V2)’X2(2)]  0  1  x1(2)  }  +  ^  ^  Cu<s>3  ds 


=  (2)32  +  [x2(2)]2  +  *  [  [u(s)]2  ds  . 

0 

r  n 

Proceeding  exactly  as  in  [  6  ]  with  y  = I  q  I  replaced  by 


■  m 


(see  pages  36-45),  one  finds  that  the  optimal  control  is  given  by 


mmmmm 
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u*(t)  = 


t-2 


t-1 


(^-6)e  +  [2g,-36-(^_6)t]e  +6(t+2)-p,  Oitjl  , 


(u-6)et  1  +  6 


,  Uti2, 


where  6  i  -  .2593  and  p,  5.2262.  The  resulting  optimal  cost  is 

J*  ~  19.7479  . 


The  convergence  of  J  to  J*  is  summarized  in  Table  (C8.1). 
Again,  the  convergence  rates  (i.e.  ,g)  agree  with  the  expected 
theoretical  values.  The  convergence  of  7  to  u*  is  described  by 
Tables  (C8.2)- (C8.4)  and  pLots  of  u^>  and  u*  are  given  in 
Figure  (C8.1) 


AVE 

SPLINE 

N 

JN 

1 

7 

1 7^*1 

8. 

4 

17.9646 

1.7832 

.87 

H 

19.9843 

.2364 

2.39 

8 

18.7745 

.9733 

.95 

8 

19.7929 

.0450 

1.72 

16 

19.2439 

.5039 

.99 

16 

19.7616 

.0137 

1.48 

32 

19.4935 

.2543 

--- 

32 

19.7528 

.0049 

1 

J*  =  19 

.  7479 

J*  = 

19.7479 

TABLE  C8.1 
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AVE 

-4 

-8 

-  16 

-32 

time 

u 

u 

u _ 

U _ 

u* 

0.00 

-.9029 

-.8782 

-.8712 

-.8701 

-.8710 

0.25 

-.3412 

-.2688 

-.2307 

-.2133 

-.1993 

0.50 

.2526 

.3612 

.4276 

.4636 

.4975 

0.75 

.8643 

.9879 

1.0680 

1.1170 

1.1745 

!  1.00 

1 

1.4926 

1.6054 

1.6739 

1.7132 

1.7587 

j  1.25 

2.1585 

2.2469 

2.2927 

2.3139 

2.3319 

j  1.50 

2.9139 

2.9886 

3.0277 

3.0476 

3.0678 

!  1-75 

3.8368 

3.9187 

3.9645 

3.9883 

4.0128 

|  2.00 

5.0122 

5.1115 

5.1673 

5.1962 

5.2262 

TABLE  C8.2 

SPLINE 

-4 

-8 

-16 

-32 

1 

u*  | 

u 

u 

u _ 

u _ 

0.00 

-.8775 

-.9746 

-.9297 

-.9010 

-.8710  i 

| 

0.25 

- . 1303 

-.2995 

-.2441 

-.2231 

-.1993 

j  0.50 

.6421 

.4472 

.4667 

.4785 

.4975 

!  0.75 

1.3224 

1.1445 

1.1595 

1.1662 

1. 1745 

1.00 

1.9007 

1.7394 

1.7560 

1.7575 

1.7587 

1.25 

2.5345 

2.3528 

2.3485 

2.3399 

2.3319 

1.50 

3.3597 

3.1217 

3.1068 

3.0871 

3.0678 

1.75 

4.2533 

4.1425 

4.0785 

4.0463 

4.0128 

2.00 

4.9126 

5.0619 

5.1643 

5.1955 

5.2262 

TABLE  C8.3 
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EXAMPLE  C9 


This  example  is  the  same  as  Example  13  in  [  6  ]  (with 

=  1,  see  page  97  of  [6  ]).  The  system  is  governed  by  the 

equation 


—  — 

— 

— 

“  — 

— 

— 

—  — 

— 

— 

Tupt)” 

X^ft) 

0 

1 

Xj^t) 

t 

0 

0 

x^t-1) 

+ 

1 

0 

1 

i 

x2(t) 

0 

-1 

x2  (t) 

-1 

0 

x2t>-  1) 

0 

1 

K(t) 

L-  — 

— 

-J 

—  — 

— 

— 

—  — 

— 

— 

with  0  ^  t  ^  2  and  initial  data 


—  — 

—  — 

x^s) 

10 

x2(s) 

0 

_  _ 

_  _ 

The  cost  function  is  given  by 

2 

J  =  h  {lx1  (2)]2  +  [x2(2)]2}  +  \  ^  {[u^s)]2  +  [u2(s)]2}  ds  . 

0 


Although  the  optimal  control  and  optimal  cost  have  not  been 
computed,  the  numerical  results  given  in  the  following  tables 
are  similar  to  the  previous  examples.  Again  it  appears 
that  SPLINE  provides  improved  convergence  propert ies  over  AVE . 


AVE 


SPLINE 


N 

JN 

|J2M-JN| 

N 

JN 

!J2N-JN| 

4 

16.2927 

.  1 

.7615 

4 

18.0819 

.  1814 

8 

17.0542 

.4084 

8 

17.9005 

.0348 

16 

17.4626 

.2014 

16 

17.8657 

.0090 

32 

17.6640 

32 

17.8567 

TABLE  C9.1 


AVE  -  u. 


a4 

A  8 

„  16 

a32 

t.  ime 

U1 

U1 

U1 

U1 

0.00 

-2.3842 

-2.5442 

-2.6432 

-2.6920 

0.25 

-1.9485 

-2.0417 

-2.1157 

-2 .1601 

0.50 

-1.4369 

-1.4407 

-1.4639 

-1.4947 

0.75 

-  .8927 

-  .  962 

-  .7311 

-  .7000 

1.00 

-  .3798 

-  .2166 

-  .0816 

.0247 

1.25 

.0235 

.1658 

.  2578 

.3042 

1.50 

.2562 

.3092 

.3221 

.3224 

1.75 

.3284 

.  3271 

.3239 

.3224 

2.00 

.3331 

.3273 

.3239 

.3224 

TABLE  C9.2 
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|  AVE  -  u2 

~  4 

-8 

-16 

-32 

time 

u 

u 

u 

U _ 

|  0.00 

-.3729 

-.3578 

-.3541 

-.3540 

0.25 

.1412 

.1975 

.2273 

.2407 

o 

Ln 

O 

.  6665 

.7536 

.8068 

1 

.8354 

t 

I  0.75 

1.1900 

1.2891 

1.3527 

1.3912 

!  1.00 

1.7101 

1.7994 

1.8512 

1.8798 

1.25 

2.2453 

2.3141 

2.3453 

2.3573 

1.50 

2.8403 

2.8999 

2.9258 

2.9364 

1 

1.75 

3.5615 

3.6321 

3.6650 

3.6788 

2.00 

4.4788 

4.5707 

4.6139 

4.6321 

TABLE  09.3 

SPLINE  -  ux 

.4 

r8 

-16 

-32 

time 

u 

G 

u _ 

u _ 

0.00 

-2.7993 

-2.7564 

-2.7430 

-2.7366 

0.25 

-2.2589 

-2.2041 

-2.2079 

-2.2025 

0.50 

-1.4849 

-1.5456 

-1.5454 

-1.5400 

0.75 

-  .5920 

-  .6683 

-  .7219 

-  .7100 

1.00 

.0951 

.1992 

.2532 

.2783 

1.25 

.3615 

.346  7 

.3292 

.3256 

1.50 

.3542 

.3351 

.3295 

.3256 

1.75 

.3336 

.3370 

.3294 

.3256 

2.00 

.3040 

.3162 

.3196 

.3206 

TAB  LF,  C9.4 


t 


SPLINE  -  u-; 


4- - 

a. 

~  16 

~32 

L  ime 

a 

u 

u 

u 

0.00 

-.1499 

-.3416 

-.3488 

-.3520 

0.25 

.3107 

.2604 

.2622 

.2555 

1  0.50 

.9737 

.9025 

.8753 

.864  9 

0.75 

1.5378 

1.4784 

1.4520 

1.4428 

1.00 

1.9986 

1.9456 

1.9266 

1.9185 

1.25 

i 

2.4949 

2.4122 

2.3821 

2.3716 

j  i-50 

3.1407 

2 . 9946 

2.9646 

2.9528 

1  1.75 

1 

3.8248 

3.7720 

3.7109 

3.6988 

j  2.00 

4.2899 

4.4311 

4.5281 

4.5842 

TABLE  C9.5 


EXAMPLE  CIO 


This  is  a  nonlinear  optimal  control  problem.  Although  the 
basic  idea  has  been  developed  only  for  linear  systems,  much  ol  tin 
theory  has  been  extended  to  a  general  class  of  nonlinear  examples 
(.see  II]).  The  system  is  given  by  the  equation 

x ( t )  =  x(t)sin[x(t)j  +  x(t'l)  +  u(t),  0  s.  t  i  2  . 

with  initial  data 


x(s)  =  10  ,  -1  £  s  S  0  . 

The  cost  function  is 

2  ,  2  2.2 
J  =  k  [x(2)]  +  h  \  ![x(s)J  +  u  ( s )  J  }  ds  . 

Jo 

...  n 

VaLues  of  J  are  given  in  Table  (C10.1).  This  problem  is  such  that 

J*  is  relative  "flat".  Consequently,  the  values  of  and  the 
„  N 

controls  u  changed  very  little  as  X  —  +  ®  .  Since  the  optimal 

control  u*  is  not  known  analytically  and  u  were  essentially  the 

-  N 

same  for  N  ;>  4,  we  did  not  give  tables  tor  u  . 


AVE 

SPLINE 

~N 

,-2N  N . 

-  N 

,  ;2N  , N  . 

X 

J 

|J  -J  1 

N 

.1 

|J  -J  | 

4 

162.020 

.0010 

\ 

162 .113 

.0720 

8 

162.019 

.0010 

8 

162.041 

.0300 

16 

162.018 

.0030 

16 

162.011 

.0080 

32 

162.013 

32 

162.003 

I  ABLE  C10.1 
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EXAMPLE  Cll 


This  is  a  nonlinear  example  with  the  same  dynamics  as 
EXAMPLE  CIO,  but  different  initial  condition.  The  system  is 
3gain  given  by 

x(t)  =  x(t)sin[x(t)]  +  x(t  -  1)  +  u(t)  ,  0  s;  t  £  2  , 


with  initial  data 

x  (s)  =  Cp(s)  ,  -1  s  s  s  0  , 


where 


V  (s)  = 


!10(s  +  1) 

-10s 


-1 


s 


-h  <  s  i  o  . 


The  cost  functional  is  given  by 

2 

J(u)  =  ^Cx(s)]2  +  ^  {[x(s)]2  +  [u(s)]2]  ds 

0 


This  nonlinear  problem  is  more  interesting  th  in  Example  CIO. 

Although  the  optimal  control  is  not  known  analytically,  the 

N 

numerical  runs  indicate  that  the  sequence  [u  ]  is  "converging"  to 
an  optimal  control.  If  one  applies  the  maximum  principle  to  the 
nonlinear  control  problem,  there  are  two  boundary  conditions  that 
the  optimal  "state"  and  multiplier  must  satisfy.  Using 
these  boundary  conditions  as  a  check  for  the 
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approximating  optimal  control  problem,  we  found  that  the  N  -  16 

SPLINE  procedure  produced  final  values  of  the  "state"  and 

"multipliers"  that  most  nearly  matched  the  boundary  conditions. 

In  view  of  this  fact  and  the  convergence  pattern  illustrated  in 

Tables  Cll.l  -C11.3,  it  is  reasonable  to  believe  that  the  N  =  16 

SPLINE  run  gives  a  good  estimate  of  the  optimal  control. 

^4  ^4  ^16 

Figure  Cll.l  compares  plots  of  ,  u^  with  u^  .  The  plots  of 
N 

Ug  for  N  =  8,  16  and  32  are  almost  identical. 


AVE 

SPLINE 

~N 

.-t2N  ,N  | 

r 

,N 

.  ■  2N  N . 

N 

J 

lJ  !  j 

N 

J 

|J  -.)  | 

4 

1.9919 

.1845 

: 

4 

2 . 5406 

.0179 

i  8 

2.1764 

.1341 

8 

2.5227 

.0013 

16 

2.3105 

.0907 

16 

2.5240 

.0010 

32 

2.4012 

32 

2.5230 

TABLE  Cll.l 


time 


)0 

-2.3013 

-2.3082 

-2.3073 

-2.3033 

!5 

-2.0915 

-2.1804 

-2.2375 

-2.2706 

►0 

-1.8241 

-1.9856 

-2.1114 

-2.1972 

r5 

-1.4673 

-1.5752 

-1.6470 

-1.6906 

-1.1190 

-1.1447 

-1.1417 

-1.1317 

1 

.25 

-  .8349 

-  .8 

1 

.50 

-  .6208 

-  .5' 

1 

..75 

-  .4580 

-  .4- 

2 

:.oo 

-  .3233 

-  .3 

SPLINE 

time 

-4 

-8 

- 16 

-32 

u 

u 

u _ 

u _ 

0.00 

-2.331 

-2.3024 

-2.3017 

-2.2967 

0.25 

-2.3707 

-2.3230 

-2.3156 

-2.3101 

0.50 

-2.2820 

-2.3034 

-2.3106 

-2.3126 

0.75 

-1.6921 

-1.7294 

-1.7404 

-1.7424 

1.00 

-1.0787 

-1.1002 

-1.1041 

-1.1037 

1.25 

-  .7160 

.7427 

-  .7462 

-  .7497 

1.50 

-  .5727 

-  .5644 

-  .5588 

-  .5624 

1.75 

-  .4978 

-  .4591 

-  .4502 

-  .4451 

2.00 

-  .3960 

-  .3496 

-  .3559 

-  .3265 
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Summary  Remarks 

In  examples  C7  and  C8  we  presented  some  estimates  for  the  rates 
N  N 

of  convergence  of  J  —  J*  and  u  -•  u .  In  these  cases  we  found  that 
the  AVE  scheme  provided  essentially  linear  convergence,  while  SPLINE 
convergence  was  essentially  quadratic.  In  view  of  some  known 
theoretical  facts  these  results  are  not  unexpected.  Specifically, 
in  [  5]  it  is  shown  that  for  fixed  control  and  sufficiently  re- 
stricted  initial  data, we  have  z  -•  z  is  0(1/NP)  where  8=1  for  AVE 
and  g  =  2  for  SPLINE.  For  the  linear  regulator  problem  (both  OC 
and  OCN)  the  optimal  control  can  be  generated  by  state  feedback. 

If  one  assumes  that  the  feedback  "parameters"  for  OCN  also  converge 

to  the  feedback  "parameters"  for  OC  (see  Delfour  [10])  like  ( I /N® ) 7 

/.N  « 

then  it  follows  that  u  -»  u*  convergence  is  0(1/ !v  ) . 

Additionally,  elementary  calculations  then  reveal  that  one  should 
have  J  —  J*  is  also  0(1/N  ).  For  the  first-order  (piecewise  linear) 
spline  based  method  SPLINE,  the  results  presented  here,  taken  with 
other  numerical  experiments  that  we  have  performed  and  reported  else¬ 
where  (see  r8  [),  are  strong  evidence  that  the  method  SPLINE 
is  essentially  second  order  (g  =  2)  when  used  with  regulator-type 
optimal  control  problems  involving  linear  delay  systems.  (This  is 
not  too  surprising  when  one  reviews  the  literature  on  finite-element 
methods  and  investigates  such  phenomena  as  super  convergence  for 
"coercive  problems"  or  "superconvergence  at  nodes".)  The  AVE  scheme, 
on  the  other  hand,  appears  to  be  at  best  only  first  order  (g  =  1) 


ft  ' 
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in  these  problems. 

As  j  further  point  of  comparison  we  note  that  SPLINE  yields  a 
better  approximation  for  a  given  value  of  N  in  almost  every  example 
that  we  have  considered  (here  and  elsewhere).  Observe  that  in 
many  of  the  control  examples  (Cl  -  C4,  C6  -  C8)  the  results  for 
SPLINE  at  N  -  4  are  better  than  those  obtained  with  AVE  for  N  -  12. 

While  the  SPLINE  scheme  is  slightly  more  tedious  to  impliment 
and  takes  a  little  more  computer  time  because  of  the  matrix  systems 
that  must  be  solved  (see  the  Remark  at  the  end  of  £3),  all  the 
evidence  would  seem  to  imply  that  SPLINE  is  a  superior  method  to 
AVE  in  control  problems  of  the  type  we  consider  here . 

For  control  problems  with  nonlinear  systems,  the  numerical 
findings  to  date  are  not  as  dramatic  or  conclusive  (in  part  perhaps 
because  analytic  solutions  are  not  available).  In  addition  to  the 
two  examples  (CIO,  Cll)  reported  here,  numerical  studies  with  other 
nonlinear  systems  tend  to  support  the  conjecture  that  SPLINE  will 
generally  be  as  good  as  or  better  than  AVE  for  nonlinear  problems. 


•T  itrtfifcifl 
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